00000001:02000400:2.0F:1789135462.515748:0:2969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789135493.713677:0:3190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1789135496.025304:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 211 MB/s 00000001:01000000:2.0:1789135496.274400:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 367 MB/s 00000001:01000000:2.0:1789135496.524800:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2387 MB/s 00000020:02000000:2.0:1789135498.114191:0:3282:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_131_gc13dec9 00000400:02000000:3.0F:1789135499.386927:0:3297:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.135@tcp [8/256/0/180] 00008000:02000000:0.0:1789135503.040673:0:3446:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789135555.020691:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1789135565.435848:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789135565.435858:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789135565.436056:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b005cf68 00000080:02000400:1.0:1789135565.436115:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789135565.441297:0:5818:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789135565.441312:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789135565.441401:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000589ad67b) 00000020:00000080:0.0:1789135565.441487:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789135565.458255:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789135565.458710:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789135565.482311:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789135565.482367:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789135565.482391:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789135565.482513:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789135565.482541:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789135565.483020:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789135565.483030:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789135565.483040:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce3bf6 00000020:01000004:2.0:1789135565.483048:0:5818:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789135565.483053:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789135565.483059:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b005cf68 from MGS 00000020:01000004:2.0:1789135565.483143:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789135565.483171:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ced150fa) 00000020:00000080:2.0:1789135565.483183:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789135565.483278:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b005cf68 from MGS, refs=2 00080000:01000000:2.0:1789135565.483284:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789135565.483289:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce3c04 00000100:00100000:2.0:1789135565.483386:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789135565.483601:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789135565.484010:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789135565.484617:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789135565.484624:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789135565.485567:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135565.485760:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789135565.485766:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789135565.486866:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789135565.486876:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789135565.487357:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789135565.487363:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789135565.488349:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135565.488352:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135565.488353:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135565.488677:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135565.488679:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135565.488686:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135565.489357:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789135565.493342:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789135565.739284:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2467 MB/s 00000001:01000000:3.0:1789135565.989201:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2975 MB/s 00000001:01000000:2.0:1789135566.242539:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 422 MB/s 00000001:01000000:3.0:1789135566.493777:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 438 MB/s 00080000:10000000:2.0:1789135566.516945:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1789135566.542164:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789135566.549828:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789135566.549872:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789135566.549875:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789135566.557742:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789135566.557827:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789135566.557895:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789135566.558246:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789135566.558271:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789135566.558677:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135566.558838:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789135566.558845:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789135566.569476:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789135566.569491:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789135566.569785:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789135566.569792:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789135566.570506:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789135566.570527:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.135@tcp' 00000020:01000004:0.0:1789135566.570529:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789135566.570580:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.135@tcp (typ=mgc) 00000020:00000080:0.0:1789135566.570591:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.135@tcp (00000000736339a3) 00000020:00000080:0.0:1789135566.570606:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789135566.570698:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d6f662b2@MGC192.168.206.135@tcp: add connection 192.168.206.135@tcp at head 00010000:00010000:0.0:1789135566.570857:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.135@tcp-0 is initialized 00000040:01000000:0.0:1789135566.570864:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789135566.573980:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789135566.576362:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.135@tcp (uuid 45dd8677-45c4-4169-a65f-287162436408) 00000020:00000080:0.0:1789135566.576391:0:5818:0:(genops.c:1385:class_connect()) connect: client 45dd8677-45c4-4169-a65f-287162436408, cookie 0x5b09da6ee1ce3c12 00000100:00080000:0.0:1789135566.576404:0:5818:0:(import.c:510:import_select_connection()) MGC192.168.206.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789135566.576411:0:5818:0:(import.c:624:import_select_connection()) MGC192.168.206.135@tcp: import 00000000d6f662b2 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1789135566.576451:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b3d3d84b x1876044544999552/t0(0) o250->MGC192.168.206.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789135566.576477:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 45dd8677-45c4-4169-a65f-287162436408->MGS 00000020:01000004:0.0:1789135566.576503:0:5818:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789135566.576509:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789135566.576521:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000076227156) 00000020:00000080:0.0:1789135566.576532:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1789135566.578276:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1789135566.587286:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b3d3d84b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:45dd8677-45c4-4169-a65f-287162436408:3312:1876044544999552:0@lo:250: 00000100:00100000:3.0:1789135566.587388:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135566.587463:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044544999552 00000100:00100000:3.0:1789135566.587471:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044544999552 00000100:00100000:3.0:1789135566.587532:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135566.587539:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095aa6f46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1876044544999552:12345-0@lo:250: 00010000:00080000:3.0:1789135566.587569:0:5830:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 45dd8677-45c4-4169-a65f-287162436408@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1789135566.587595:0:5830:0:(genops.c:1385:class_connect()) connect: client 45dd8677-45c4-4169-a65f-287162436408, cookie 0x5b09da6ee1ce3c20 00000100:00080000:3.0:1789135566.587729:0:5830:0:(import.c:65:import_set_state_nolock()) 0000000021d76759 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135566.587787:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095aa6f46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+5:3312:x1876044544999552:12345-0@lo:250: Request processed in 246us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135566.587796:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135566.587845:0:3312:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789135566.587857:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.135@tcp: connect to target with instance 0 00000100:00080000:3.0:1789135566.587864:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789135566.587870:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789135566.587880:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000d6f662b2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789135566.587883:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789135566.587892:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789135566.587898:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b3d3d84b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:45dd8677-45c4-4169-a65f-287162436408:3312:1876044544999552:0@lo:250: 00000100:00100000:1.0:1789135566.625822:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135566.626039:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789135566.626046:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789135566.627699:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789135566.627712:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789135566.633364:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789135566.633375:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789135566.634256:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135566.634435:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789135566.634440:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789135566.638240:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789135566.638259:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789135566.745475:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135566.745759:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789135566.745766:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789135566.746968:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789135566.746980:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789135566.747847:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135566.748057:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135566.748091:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789135566.748644:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789135566.748651:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789135566.750156:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135566.750358:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789135566.750365:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789135566.756465:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789135566.756480:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789135566.771629:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135566.771808:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135566.771814:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789135566.775157:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789135566.775173:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789135566.860685:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135566.861682:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789135566.861691:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789135566.866209:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789135566.866225:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789135566.869030:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789135566.870384:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789135566.878283:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789135566.878312:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789135566.878319:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789135566.878468:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789135566.878508:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.135@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789135566.878512:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789135566.878514:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789135566.878515:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135566.878517:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135566.878518:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135566.878520:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135566.878521:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789135566.878522:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789135566.878524:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135566.878525:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135566.878526:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135566.878528:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135566.878530:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789135566.878532:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789135566.878532:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789135566.878533:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135566.878534:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135566.878535:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135566.878536:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135566.878537:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789135566.878538:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789135566.878539:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135566.878540:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135566.878544:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135566.878545:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135566.878577:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789135566.878596:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d78b7091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044544999680:0@lo:253: 00000100:00100000:0.0:1789135566.878684:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135566.878745:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f5ed375 going to sleep for 11 seconds 00000100:00100000:3.0:1789135566.881337:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044544999680 00000100:00100000:3.0:1789135566.881355:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044544999680 00000100:00100000:3.0:1789135566.881428:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135566.881439:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df92f7aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+5:5818:x1876044544999680:12345-0@lo:253: 20000000:01000000:3.0:1789135566.881510:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789135566.881514:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789135566.885747:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789135566.886168:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789135566.886675:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135566.888665:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789135566.889204:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789135566.889209:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789135566.889215:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789135566.889218:0:5832:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789135566.889229:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789135566.889471:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135566.889697:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789135566.889711:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789135566.889765:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789135566.890497:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789135566.890543:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789135566.890658:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789135566.890667:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789135566.890712:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789135566.890720:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789135566.890750:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789135566.890756:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789135566.899345:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789135566.899498:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789135566.899572:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789135566.899580:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789135566.899596:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135566.900318:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789135566.901252:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789135566.901654:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789135566.901700:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789135566.901767:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789135566.902904:0:5832:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789135566.903344:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789135566.903361:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789135566.903463:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789135566.903507:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789135566.903546:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789135566.903560:0:5832:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789135566.903667:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789135566.903677:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789135566.903715:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789135566.903755:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789135566.904694:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789135566.904755:0:5832:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789135566.904763:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789135566.914262:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789135566.914884:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789135566.914912:0:5832:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.135@tcp for mdt 20000000:01000000:1.0:1789135566.914915:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:1.0:1789135566.914966:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789135566.914974:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789135566.915003:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789135566.915010:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:1.0:1789135566.915054:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789135566.915098:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789135566.915134:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789135566.915185:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789135566.915247:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789135566.915251:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789135566.915254:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789135566.915279:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789135566.915282:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789135566.915311:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789135566.915313:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789135566.916762:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789135566.917182:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789135566.917231:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789135566.917267:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789135566.917280:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789135566.917283:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789135566.918167:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789135566.918432:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789135566.918475:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789135566.918539:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1789135566.918553:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789135566.918556:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789135566.918562:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789135566.918564:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789135566.918576:0:5832:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789135566.918581:0:5832:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789135566.920243:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789135566.920962:0:5832:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789135566.942912:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789135566.942977:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789135566.943131:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789135566.943168:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789135566.943192:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943211:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943223:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943229:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943236:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943243:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943250:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075465e08 already unused, calling callback (000000001cc62b0f) 00010000:00010000:0.0:1789135566.943254:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943261:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943287:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943294:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135566.943300:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000075465e08/0x5b09da6ee1ce3c27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789135566.943322:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789135567.232760:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df92f7aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+5:5818:x1876044544999680:12345-0@lo:253: Request processed in 351316us (354068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135567.232780:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135567.232935:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d78b7091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044544999680:0@lo:253: 10000000:01000000:3.0:1789135567.232955:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789135567.232969:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135567.232971:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789135567.232972:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135567.232973:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789135567.232975:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135567.232976:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135567.232978:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135567.232979:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789135567.232980:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789135567.232982:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135567.232983:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789135567.233007:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b005cf68 from lustre-MDT0000 10000000:01000000:3.0:1789135567.233034:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789135567.233037:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789135567.233041:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8adc06b64ed8 10000000:01000000:3.0:1789135567.233045:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135567.233054:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adc06b64ed8 from 1 10000000:01000000:3.0:1789135567.233057:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789135567.233130:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.233151:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.233160:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135567.233180:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044544999808:0@lo:101: 00000100:00100000:3.0:1789135567.233224:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.233287:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b49947d going to sleep for 11 seconds 00000100:00100000:1.0:1789135567.233386:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044544999808 00000100:00100000:1.0:1789135567.233394:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044544999808 00000100:00100000:1.0:1789135567.233442:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135567.233450:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee9915a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+5:5818:x1876044544999808:12345-0@lo:101: 00010000:00010000:1.0:1789135567.233465:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135567.233479:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3c2e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135567.233505:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135567.233516:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135567.233526:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a1ac699c, rc 0) 00000100:00100000:1.0:1789135567.233583:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee9915a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+6:5818:x1876044544999808:12345-0@lo:101: Request processed in 134us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135567.233590:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135567.233667:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044544999808:0@lo:101: 00010000:00010000:3.0:1789135567.233680:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.233698:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135567.233755:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044544999936:0@lo:501: 00000100:00100000:3.0:1789135567.233782:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.233804:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b49947d going to sleep for 11 seconds 00000100:00100000:1.0:1789135567.233901:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044544999936 00000100:00100000:1.0:1789135567.233905:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044544999936 00000100:00100000:1.0:1789135567.233935:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135567.233941:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da0feb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+6:5818:x1876044544999936:12345-0@lo:501: 00000100:00100000:1.0:1789135567.234200:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da0feb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+6:5818:x1876044544999936:12345-0@lo:501: Request processed in 258us (416us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135567.234207:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135567.234487:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044544999936:0@lo:501: 10000000:01000000:3.0:1789135567.234515:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789135567.234536:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.234544:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135567.234552:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adc10b30000 10000000:01000000:3.0:1789135567.234556:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789135567.234559:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8adc10b30000 10000000:01000000:3.0:1789135567.234561:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789135567.234569:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8adc10b30000 from 1 10000000:01000000:3.0:1789135567.234572:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789135567.234595:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000cddeb983/0x5b09da6ee1ce3c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.234602:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000cddeb983/0x5b09da6ee1ce3c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.234609:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000cddeb983/0x5b09da6ee1ce3c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135567.234631:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000064:0@lo:101: 00000100:00100000:3.0:1789135567.234661:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.234694:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b49947d going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.234812:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545000064 00000100:00100000:2.0:1789135567.234818:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545000064 00000100:00100000:2.0:1789135567.234850:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135567.234857:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000238d4853 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+6:5818:x1876044545000064:12345-0@lo:101: 00010000:00010000:2.0:1789135567.234866:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135567.234878:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd4f2502/0x5b09da6ee1ce3c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3c3c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.234894:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd4f2502/0x5b09da6ee1ce3c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c3c expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.234902:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd4f2502/0x5b09da6ee1ce3c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c3c expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.234909:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd4f2502, rc 0) 00000100:00100000:2.0:1789135567.234951:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000238d4853 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+7:5818:x1876044545000064:12345-0@lo:101: Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.234962:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135567.235037:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000064:0@lo:101: 00010000:00010000:3.0:1789135567.235049:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000cddeb983/0x5b09da6ee1ce3c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.235057:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000cddeb983/0x5b09da6ee1ce3c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135567.235158:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789135567.235161:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000cddeb983/0x5b09da6ee1ce3c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.235167:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000cddeb983/0x5b09da6ee1ce3c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135567.235173:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789135567.235177:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135567.235182:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8adc10b30000 10000000:01000000:3.0:1789135567.235183:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789135567.235186:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789135567.235188:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789135567.235203:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.235209:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.235227:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135567.235239:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000192:0@lo:101: 00000100:00100000:3.0:1789135567.235268:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.235285:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b49947d going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.235340:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545000192 00000100:00100000:2.0:1789135567.235345:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545000192 00000100:00100000:2.0:1789135567.235372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135567.235378:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015481618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+7:5818:x1876044545000192:12345-0@lo:101: 00010000:00010000:2.0:1789135567.235385:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135567.235392:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3c4a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.235406:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.235413:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.235419:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a637fab1, rc 0) 00000100:00100000:2.0:1789135567.235446:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015481618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+8:5818:x1876044545000192:12345-0@lo:101: Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.235451:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135567.235523:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000192:0@lo:101: 00010000:00010000:3.0:1789135567.235533:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.235540:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135567.235581:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000320:0@lo:501: 00000100:00100000:3.0:1789135567.235604:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.235732:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b49947d going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.235926:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545000320 00000100:00100000:2.0:1789135567.235931:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545000320 00000100:00100000:2.0:1789135567.235959:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789135567.235966:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007034b57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+8:5818:x1876044545000320:12345-0@lo:501: 00000100:00100000:2.0:1789135567.236298:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007034b57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+9:5818:x1876044545000320:12345-0@lo:501: Request processed in 333us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.236306:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135567.236393:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c9a1995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000320:0@lo:501: 00000100:00100000:1.0:1789135567.236433:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000448:0@lo:503: 00000100:00100000:1.0:1789135567.236474:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135567.236504:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4b54982 going to sleep for 11 seconds 00000100:00100000:0.0:1789135567.236563:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545000448 00000100:00100000:0.0:1789135567.236569:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545000448 00000100:00100000:0.0:1789135567.236592:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135567.236598:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eee6d986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+9:5818:x1876044545000448:12345-0@lo:503: 00000100:00100000:0.0:1789135567.236833:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eee6d986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+9:5818:x1876044545000448:12345-0@lo:503: Request processed in 236us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135567.236840:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135567.236922:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000448:0@lo:503: 00000100:00100000:3.0:1789135567.237406:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:5859:1876044545000576:0@lo:502: 00000100:00100000:3.0:1789135567.237448:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.237480:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df14a47d going to sleep for 11 seconds 00000100:00100000:0.0:1789135567.237533:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545000576 00000100:00100000:0.0:1789135567.237539:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545000576 00000100:00100000:0.0:1789135567.237572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135567.237578:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006765425a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+9:5859:x1876044545000576:12345-0@lo:502: 00000100:00100000:0.0:1789135567.237861:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006765425a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+9:5859:x1876044545000576:12345-0@lo:502: Request processed in 283us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135567.237870:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135567.237956:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:5859:1876044545000576:0@lo:502: 00000020:01000000:3.0:1789135567.237979:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135567.237989:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135567.237991:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789135567.237996:0:5859:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789135567.237999:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135567.238021:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005cab5ce3) 00000020:00000080:3.0:1789135567.238041:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789135567.238047:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789135567.238169:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789135567.238177:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce3c5f 00000020:00000080:3.0:1789135567.238528:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789135567.238533:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135567.238537:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135567.238538:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789135567.238541:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135567.238544:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135567.238545:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789135567.238549:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135567.238555:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000081faf47c) 00000020:00000080:3.0:1789135567.238565:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789135567.238569:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789135567.238570:0:5859:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789135567.238573:0:5859:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789135567.238578:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789135567.238623:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b005cf68 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789135567.238634:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000069efcc23) 00000020:00000080:3.0:1789135567.238652:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789135567.238710:0:5859:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789135567.238716:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce3c74 00000020:00000080:3.0:1789135567.239016:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789135567.239023:0:5859:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789135567.239027:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5b09da6ee1ce3c7b 00080000:01000000:3.0:1789135567.239032:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789135567.239035:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce3c82 00080000:10000000:3.0:1789135567.239465:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789135567.239675:0:5859:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789135567.243668:0:5859:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789135567.353450:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789135567.353965:0:5859:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789135567.356777:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789135567.357105:0:5859:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789135567.416858:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009ff6c507) 00000020:00000080:0.0:1789135567.416880:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789135567.416949:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789135567.416956:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce3c90 00000020:00000080:0.0:1789135567.418288:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789135567.422623:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789135567.484253:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789135567.514570:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789135567.561186:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:3.0:1789135567.566914:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789135567.603209:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789135567.649953:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789135567.694772:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5b09da6ee1ce3c97 00000020:00000080:1.0:1789135567.695469:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789135567.695481:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135567.695487:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135567.695489:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789135567.695492:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135567.695495:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135567.695497:0:5859:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135567.695499:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135567.695500:0:5859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789135567.695503:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135567.695505:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135567.695506:0:5859:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789135567.695508:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135567.695511:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135567.695513:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789135567.695516:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789135567.695550:0:5859:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789135567.695611:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:5859:1876044545000704:0@lo:502: 00000100:00100000:1.0:1789135567.695690:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135567.695923:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bda07c11 going to sleep for 11 seconds 00000100:00100000:3.0:1789135567.696031:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545000704 00000100:00100000:3.0:1789135567.696040:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545000704 00000100:00100000:3.0:1789135567.696155:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135567.696165:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c508bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+9:5859:x1876044545000704:12345-0@lo:502: 00000100:00100000:3.0:1789135567.696587:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c508bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+9:5859:x1876044545000704:12345-0@lo:502: Request processed in 423us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135567.696596:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135567.696686:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:5859:1876044545000704:0@lo:502: 00000020:01000000:1.0:1789135567.696735:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135567.696740:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135567.696742:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789135567.696746:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789135567.696966:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789135567.696982:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789135567.697003:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.697014:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135567.697022:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc10b30000 from 1 10000000:01000000:0.0:1789135567.697025:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135567.697059:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.697092:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.697102:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135567.697118:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000832:0@lo:101: 00000100:00100000:0.0:1789135567.697177:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135567.697659:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000065282b73 going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.697745:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545000832 00000100:00100000:2.0:1789135567.697753:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545000832 00000100:00100000:2.0:1789135567.697793:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135567.697801:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5a07a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+9:5818:x1876044545000832:12345-0@lo:101: 00010000:00010000:2.0:1789135567.697814:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135567.697829:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3c9e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.697853:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.697862:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.697872:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072ba0488, rc 0) 00000100:00100000:2.0:1789135567.697918:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5a07a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:5818:x1876044545000832:12345-0@lo:101: Request processed in 118us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.697926:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135567.698103:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000832:0@lo:101: 00010000:00010000:0.0:1789135567.698118:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.698144:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135567.698702:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000960:0@lo:256: 00000100:00100000:0.0:1789135567.698762:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135567.698803:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000065282b73 going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.699146:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545000960 00000100:00100000:2.0:1789135567.699154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545000960 00000100:00100000:2.0:1789135567.699186:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135567.699193:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c669953 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:5818:x1876044545000960:12345-0@lo:256: 20000000:01000000:2.0:1789135567.699212:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789135567.699218:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789135567.699447:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c669953 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:5818:x1876044545000960:12345-0@lo:256: Request processed in 255us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.699455:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135567.699554:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545000960:0@lo:256: 10000000:01000000:0.0:1789135567.700464:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789135567.700484:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.700496:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135567.700504:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc10b30000 from 1 10000000:01000000:0.0:1789135567.700507:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135567.700544:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.700551:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.700561:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135567.700578:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001088:0@lo:101: 00000100:00100000:0.0:1789135567.700629:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135567.700669:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000065282b73 going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.700770:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545001088 00000100:00100000:2.0:1789135567.700778:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545001088 00000100:00100000:2.0:1789135567.700932:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135567.700940:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000740ffc76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:5818:x1876044545001088:12345-0@lo:101: 00010000:00010000:2.0:1789135567.700954:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135567.700967:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3cac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.700990:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.700999:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.701008:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007cc3c1e6, rc 0) 00000100:00100000:2.0:1789135567.701053:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000740ffc76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:5818:x1876044545001088:12345-0@lo:101: Request processed in 114us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.701060:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135567.701180:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001088:0@lo:101: 00010000:00010000:0.0:1789135567.701193:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.701203:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135567.701440:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001216:0@lo:501: 00000100:00100000:0.0:1789135567.701469:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135567.701499:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000065282b73 going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.701554:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545001216 00000100:00100000:2.0:1789135567.701558:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545001216 00000100:00100000:2.0:1789135567.701577:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135567.701583:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098a785f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:5818:x1876044545001216:12345-0@lo:501: 00000100:00100000:2.0:1789135567.702399:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098a785f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:5818:x1876044545001216:12345-0@lo:501: Request processed in 815us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.702409:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135567.702594:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001216:0@lo:501: 00000100:00100000:0.0:1789135567.702633:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001344:0@lo:503: 00000100:00100000:0.0:1789135567.702679:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135567.702709:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000065282b73 going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.702895:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545001344 00000100:00100000:2.0:1789135567.702901:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545001344 00000100:00100000:2.0:1789135567.702926:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789135567.702934:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e9ee09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:5818:x1876044545001344:12345-0@lo:503: 00000040:00080000:2.0:1789135567.702978:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135567.703026:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e9ee09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:5818:x1876044545001344:12345-0@lo:503: Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.703033:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135567.703207:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001344:0@lo:503: 00000040:00080000:2.0:1789135567.704906:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789135567.705522:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789135567.705543:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135567.705567:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.705581:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135567.705626:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789135567.705629:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adc10b30000 10000000:01000000:0.0:1789135567.705632:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adc10b30000 10000000:01000000:0.0:1789135567.705636:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789135567.705653:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc10b30000 from 1 10000000:01000000:0.0:1789135567.705656:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789135567.705697:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.705705:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.705885:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135567.705911:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001472:0@lo:101: 00000100:00100000:0.0:1789135567.705981:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135567.706028:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d2d2b98 going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.706116:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545001472 00000100:00100000:2.0:1789135567.706125:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545001472 00000100:00100000:2.0:1789135567.706181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135567.706191:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd9e5c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:5818:x1876044545001472:12345-0@lo:101: 00010000:00010000:2.0:1789135567.706208:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135567.706222:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3cba expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.706466:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.706480:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135567.706490:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa4ec628, rc 0) 00000100:00100000:2.0:1789135567.706544:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd9e5c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:5818:x1876044545001472:12345-0@lo:101: Request processed in 354us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.706552:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135567.706636:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001472:0@lo:101: 00010000:00010000:1.0:1789135567.706652:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135567.706662:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135567.706842:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001600:0@lo:501: 00000100:00100000:1.0:1789135567.706876:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135567.706904:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bda07c11 going to sleep for 11 seconds 00000100:00100000:0.0:1789135567.706959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545001600 00000100:00100000:0.0:1789135567.706963:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545001600 00000100:00100000:0.0:1789135567.706984:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135567.706989:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b98069 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:5818:x1876044545001600:12345-0@lo:501: 00000100:00100000:0.0:1789135567.707488:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b98069 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:5818:x1876044545001600:12345-0@lo:501: Request processed in 497us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135567.707495:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135567.707576:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001600:0@lo:501: 00000100:00100000:1.0:1789135567.707611:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001728:0@lo:503: 00000100:00100000:1.0:1789135567.707652:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135567.707674:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bda07c11 going to sleep for 11 seconds 00000100:00100000:0.0:1789135567.707855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545001728 00000100:00100000:0.0:1789135567.707861:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545001728 00000100:00100000:0.0:1789135567.707885:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789135567.707892:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021613bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:5818:x1876044545001728:12345-0@lo:503: 00000100:00100000:0.0:1789135567.708556:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021613bff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:5818:x1876044545001728:12345-0@lo:503: Request processed in 662us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135567.708566:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135567.708916:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545001728:0@lo:503: 00000100:00100000:3.0:1789135567.709681:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:5864:1876044545001856:0@lo:502: 00000100:00100000:3.0:1789135567.709874:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.709942:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000af1fa679 going to sleep for 11 seconds 00000100:00100000:2.0:1789135567.709986:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545001856 00000100:00100000:2.0:1789135567.709994:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545001856 00000100:00100000:2.0:1789135567.710103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789135567.710112:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001897bc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:5864:x1876044545001856:12345-0@lo:502: 00000100:00100000:2.0:1789135567.710585:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001897bc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:5864:x1876044545001856:12345-0@lo:502: Request processed in 473us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135567.710599:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789135567.710693:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:5864:1876044545001856:0@lo:502: 00000020:01000004:3.0:1789135567.710772:0:5864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789135567.710910:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002a27118e) 00000020:00000080:3.0:1789135567.710929:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789135567.711002:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b005cf68 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789135567.711006:0:5864:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b005cf68 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789135567.711009:0:5864:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b005cf68 4 00010000:00080000:3.0:1789135567.711040:0:5864:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fac2f7fd@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:3.0:1789135567.713641:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789135567.714086:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789135567.714123:0:5864:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789135567.714144:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5b09da6ee1ce3ccf 00000100:00080000:3.0:1789135567.714155:0:5864:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789135567.714161:0:5864:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000fac2f7fd using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135567.714204:0:5864:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005145de89 x1876044545001984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135567.714438:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545001984:0@lo:38: 00000100:00100000:3.0:1789135567.714516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.714590:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545001984 00000100:00100000:3.0:1789135567.714598:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545001984 00000100:00100000:3.0:1789135567.714634:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135567.714641:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7bcc5b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876044545001984:12345-0@lo:38: 00000100:00100000:3.0:1789135567.714698:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7bcc5b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876044545001984:12345-0@lo:38: Request processed in 56us (183us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789135567.714706:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135567.714887:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789135567.714896:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000fac2f7fd lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789135567.714911:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789135567.714914:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545001984:0@lo:38: 00000100:00080000:3.0:1789135567.715480:0:5864:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789135567.716081:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:5864:1876044545002112:0@lo:502: 00000100:00100000:3.0:1789135567.716177:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135567.716220:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079fd3d38 going to sleep for 11 seconds 00000100:00100000:0.0:1789135567.716507:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545002112 00000100:00100000:0.0:1789135567.716522:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545002112 00000100:00100000:0.0:1789135567.716572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135567.716580:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068078fe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:5864:x1876044545002112:12345-0@lo:502: 00000100:00100000:0.0:1789135567.717097:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068078fe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:5864:x1876044545002112:12345-0@lo:502: Request processed in 516us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135567.717107:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135567.720467:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:5864:1876044545002112:0@lo:502: 00000040:00080000:3.0:1789135567.720519:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789135567.721034:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789135567.721057:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789135567.721104:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135567.721117:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789135567.721190:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789135567.721193:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789135567.721195:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789135567.721195:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789135567.721196:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789135567.721198:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789135567.721199:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789135567.721201:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789135567.721202:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789135567.721204:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789135567.721206:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789135567.721207:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789135567.721211:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789135567.721213:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789135567.721214:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789135567.721215:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789135567.721216:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789135567.721217:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789135567.721219:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789135567.721220:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789135567.721220:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789135567.721221:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789135567.721222:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789135567.721223:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789135567.721224:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789135567.721434:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789135567.721453:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545002240:0@lo:253: 00000100:00100000:1.0:1789135567.721522:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135567.721571:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bda07c11 going to sleep for 11 seconds 00000100:00100000:3.0:1789135567.721868:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545002240 00000100:00100000:3.0:1789135567.721876:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545002240 00000100:00100000:3.0:1789135567.721925:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135567.721934:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d11bbb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:5818:x1876044545002240:12345-0@lo:253: 20000000:01000000:3.0:1789135567.721974:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789135567.721988:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789135567.777708:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789135567.777731:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789135567.777955:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789135567.777960:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789135567.777984:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.778005:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.778013:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.778059:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.778179:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 12 pid: 5832 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135567.778196:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1876044545002368:0@lo:104: 00000100:00100000:0.0:1789135567.778464:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135567.778534:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set 000000007eba3545 going to sleep for 11 seconds 00000100:00100000:3.0:1789135567.778627:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545002368 00000100:00100000:3.0:1789135567.778649:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545002368 00000100:00100000:3.0:1789135567.778703:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135567.778711:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d78b7091 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+3:5852:x1876044545002368:12345-0@lo:104: 00010000:00010000:3.0:1789135567.778734:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.778872:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135567.778878:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d78b7091 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+3:5852:x1876044545002368:12345-0@lo:104: Request processed in 169us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135567.778886:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789135567.778911:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135567.778916:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.778924:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000391f7e5 already unused, calling callback (00000000ec300ad2) 10000000:00010000:3.0:1789135567.778926:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.778934:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135567.778940:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135567.778944:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789135567.778976:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.778982:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135567.778995:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.779008:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: 000000000391f7e5/0x5b09da6ee1ce3c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ca5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.779024:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135567.779025:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135567.779027:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135567.779512:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545002496:0@lo:103: 00000100:00100000:0.0:1789135567.779556:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135567.779631:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1876044545002368:0@lo:104: 00010000:00010000:0.0:1789135567.779654:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135567.779910:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545002496 00000100:00100000:3.0:1789135567.779918:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545002496 00010000:00010000:3.0:1789135567.779941:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 13 pid: 5832 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135567.779978:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135567.779986:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d3d84b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+13:3314:x1876044545002496:12345-0@lo:103: 00010000:00010000:3.0:1789135567.779999:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135567.780004:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 13 pid: 5832 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780086:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 13 pid: 5832 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780592:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000072ba0488/0x5b09da6ee1ce3ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c9e expref: 13 pid: 5832 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780611:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780620:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789135567.780651:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002690794s 00010000:00010000:3.0:1789135567.780656:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780661:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780666:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780671:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780676:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b446b0d9 already unused, calling callback (000000001cc62b0f) 00010000:00010000:3.0:1789135567.780680:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780687:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780700:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135567.780709:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135567.780763:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d3d84b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+12:3314:x1876044545002496:12345-0@lo:103: Request processed in 777us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135567.780772:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135567.781057:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005145de89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545002496:0@lo:103: 00010000:00010000:0.0:1789135567.781204:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.781212:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135567.781218:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b446b0d9/0x5b09da6ee1ce3cd6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135567.794503:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d11bbb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:5818:x1876044545002240:12345-0@lo:253: Request processed in 72562us (72974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135567.794519:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789135567.794624:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f22bfd52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:5818:1876044545002240:0@lo:253: 10000000:01000000:1.0:1789135567.794642:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789135567.794646:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789135567.794648:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789135567.794649:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789135567.794650:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789135567.794657:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789135567.794659:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789135567.794660:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789135567.794661:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789135567.794663:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789135567.794664:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789135567.794666:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789135567.794667:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789135567.794684:0:5818:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789135567.813241:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135567.813642:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789135567.813863:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135567.814057:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789135567.814323:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135567.814515:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789135567.815411:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789135567.815600:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789135567.815800:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789135567.815976:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789135567.816277:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789135567.816460:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789135567.851488:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789135567.935095:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789135567.936588:0:5869:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789135567.936597:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789135567.942410:0:5870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789135567.953657:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789135567.954785:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789135567.955578:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789135567.955593:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789135567.955773:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135567.957482:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789135567.959542:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789135567.959600:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789135567.960229:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789135567.960756:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789135567.964101:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789135567.967396:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789135567.967635:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789135567.968567:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789135567.969608:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789135567.969840:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789135567.969994:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789135567.970178:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789135567.971756:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789135567.973571:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789135567.975546:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789135567.976547:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789135567.976710:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789135567.977024:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789135567.977218:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789135567.977363:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789135567.979502:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789135567.980773:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789135567.981021:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789135567.981183:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789135567.982983:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789135567.983596:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789135567.986055:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789135567.986356:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789135567.986508:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789135567.986637:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789135567.986814:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789135567.986941:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789135567.987132:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789135567.987286:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789135567.987432:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789135567.987606:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789135567.987821:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789135568.048802:0:5870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789135568.136256:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789135568.136296:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f1c1d5b988 00100000:10000000:2.0:1789135568.136305:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789135568.141913:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789135568.141932:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789135568.141948:0:5818:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789135568.141974:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789135568.225447:0:5870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789135568.225523:0:5870:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789135568.225529:0:5870:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789135568.588347:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135569.612297:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135570.642131:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135571.661528:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135572.685293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789135573.013288:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789135573.013298:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789135573.013301:0:38:0:(import.c:65:import_set_state_nolock()) 00000000fac2f7fd lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789135573.013315:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000fac2f7fd using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1789135573.013341:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d694b440 x1876044545002752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789135573.013435:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135573.013449:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545002624:0@lo:400: 00000100:00100000:0.0:1789135573.013522:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135573.013578:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d694b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545002752:0@lo:38: 00000100:00100000:0.0:1789135573.013816:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135573.013863:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545002624 00000100:00100000:0.0:1789135573.013872:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545002624 00000100:00100000:0.0:1789135573.013916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135573.013925:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000335b9476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+11:3316:x1876044545002624:12345-0@lo:400: 00000100:00100000:0.0:1789135573.013989:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000335b9476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+11:3316:x1876044545002624:12345-0@lo:400: Request processed in 65us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135573.013996:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135573.014087:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004951fb2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545002624:0@lo:400: 00000100:00100000:2.0:1789135573.014175:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545002752 00000100:00100000:2.0:1789135573.014181:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545002752 00000100:00100000:2.0:1789135573.014203:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135573.014207:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c66a17a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876044545002752:12345-0@lo:38: 00010000:00080000:2.0:1789135573.014231:0:5838:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:2.0:1789135573.014304:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5b09da6ee1ce3cdd 00000004:00100000:2.0:1789135573.014350:0:5838:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789135573.014473:0:5838:0:(import.c:65:import_set_state_nolock()) 0000000036026cd7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135573.014517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c66a17a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044545002752:12345-0@lo:38: Request processed in 308us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135573.014524:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789135573.014606:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d694b440 x1876044545002752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789135573.014622:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789135573.014630:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789135573.014635:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789135573.014637:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000fac2f7fd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789135573.014642:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d694b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545002752:0@lo:38: 00000001:02000400:0.0:1789135573.103367:0:6113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789135573.709230:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135574.733217:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135575.756414:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789135576.078395:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789135576.078403:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc10b30000 from 3 10000000:01000000:0.0:1789135576.078408:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135576.078458:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 000000002e665ef1/0x5b09da6ee1ce3ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135576.078471:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 000000002e665ef1/0x5b09da6ee1ce3ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135576.078482:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 000000002e665ef1/0x5b09da6ee1ce3ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135576.078508:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d694b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545002880:0@lo:101: 00000100:00100000:0.0:1789135576.078583:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135576.078762:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000268f1f87 going to sleep for 11 seconds 00000100:00100000:3.0:1789135576.079794:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545002880 00000100:00100000:3.0:1789135576.079805:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545002880 00000100:00100000:3.0:1789135576.079870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789135576.079887:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000015cdbc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:5834:x1876044545002880:12345-0@lo:101: 00010000:00010000:3.0:1789135576.079906:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135576.079924:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fb2afa2/0x5b09da6ee1ce3ceb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3ce4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135576.079952:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fb2afa2/0x5b09da6ee1ce3ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135576.079963:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fb2afa2/0x5b09da6ee1ce3ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135576.079973:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fb2afa2, rc 0) 00000100:00100000:3.0:1789135576.080045:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000015cdbc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545002880:12345-0@lo:101: Request processed in 160us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135576.080052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135576.080325:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d694b440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545002880:0@lo:101: 00010000:00010000:1.0:1789135576.080345:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 000000002e665ef1/0x5b09da6ee1ce3ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135576.080354:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 000000002e665ef1/0x5b09da6ee1ce3ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135576.080424:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c5c9000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545003008:0@lo:256: 00000100:00100000:1.0:1789135576.080463:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135576.080492:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc269f2d going to sleep for 11 seconds 00000100:00100000:2.0:1789135576.080553:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545003008 00000100:00100000:2.0:1789135576.080558:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545003008 00000100:00100000:2.0:1789135576.080599:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135576.080606:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9637f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545003008:12345-0@lo:256: 20000000:01000000:2.0:1789135576.080620:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789135576.080651:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789135576.080655:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789135576.080749:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9637f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545003008:12345-0@lo:256: Request processed in 144us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135576.080757:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789135576.080882:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c5c9000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545003008:0@lo:256: 10000000:01000000:1.0:1789135576.080926:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789135576.080934:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 000000002e665ef1/0x5b09da6ee1ce3ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135576.080941:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 000000002e665ef1/0x5b09da6ee1ce3ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135576.780219:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135577.804271:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135578.127221:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135578.127239:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000030f2a58c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545003264:0@lo:400: 00000100:00100000:0.0:1789135578.127289:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e77e3149 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545003136:0@lo:400: 00000100:00100000:0.0:1789135578.128206:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135578.129733:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545003136 00000100:00100000:1.0:1789135578.129747:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545003136 00000100:00100000:1.0:1789135578.129807:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135578.129816:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085dec768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:3315:x1876044545003136:12345-0@lo:400: 00000100:00100000:1.0:1789135578.129908:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085dec768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:3315:x1876044545003136:12345-0@lo:400: Request processed in 93us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135578.129916:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135578.129976:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e77e3149 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545003136:0@lo:400: 00000100:00100000:2.0:1789135578.132166:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135578.133719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545003264 00000100:00100000:1.0:1789135578.133733:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545003264 00000100:00100000:1.0:1789135578.134151:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135578.134161:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000463c1e2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545003264:12345-0@lo:400: 00000100:00100000:1.0:1789135578.135437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000463c1e2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545003264:12345-0@lo:400: Request processed in 1274us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135578.135450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789135578.135990:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000030f2a58c x1876044545003264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135578.136008:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000030f2a58c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545003264:0@lo:400: 00000020:00000080:3.0:1789135578.509675:0:6315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd461f80b0 20000000:00000080:3.0:1789135578.509693:0:6315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc34081400 uarg=0000000000000000 20000000:01000000:3.0:1789135578.509726:0:6315:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789135578.509733:0:6315:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789135578.509738:0:6315:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789135578.509980:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789135578.509994:0:6315:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789135578.515326:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135578.516513:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789135578.516589:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789135578.516642:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789135578.516663:0:6315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789135578.516683:0:6315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135578.516703:0:6315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135578.516712:0:6315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135578.516775:0:6315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135578.516792:0:6315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 11 pid: 5832 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135578.516808:0:6315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af039f71 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1876044545003392:0@lo:104: 00000100:00100000:3.0:1789135578.516878:0:6315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135578.516940:0:6315:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ad960db going to sleep for 11 seconds 00000100:00100000:1.0:1789135578.516970:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545003392 00000100:00100000:1.0:1789135578.516980:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545003392 00000100:00100000:1.0:1789135578.517038:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135578.517048:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0910430 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:6315:x1876044545003392:12345-0@lo:104: 00010000:00010000:1.0:1789135578.517111:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517179:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135578.517185:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0910430 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:6315:x1876044545003392:12345-0@lo:104: Request processed in 139us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135578.517192:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789135578.517215:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135578.517220:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517229:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9776ad3 already unused, calling callback (00000000ec300ad2) 10000000:00010000:1.0:1789135578.517231:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517239:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135578.517247:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135578.517252:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135578.517281:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517288:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135578.517306:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517313:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: 00000000c9776ad3/0x5b09da6ee1ce3cac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3cb3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517337:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135578.517339:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135578.517341:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135578.517360:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f746b23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545003520:0@lo:103: 00000100:00100000:1.0:1789135578.517390:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135578.517466:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545003520 00000100:00100000:1.0:1789135578.517471:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545003520 00010000:00010000:1.0:1789135578.517490:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 12 pid: 5832 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135578.517511:0:6315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af039f71 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1876044545003392:0@lo:104: 00000100:00100000:1.0:1789135578.517518:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135578.517525:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c5c9000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+12:3314:x1876044545003520:12345-0@lo:103: 00010000:00010000:2.0:1789135578.517534:0:6315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517537:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135578.517545:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 12 pid: 5832 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517557:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 12 pid: 5832 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517570:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007cc3c1e6/0x5b09da6ee1ce3cb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cac expref: 12 pid: 5832 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517583:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517603:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517616:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517628:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517635:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517641:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517646:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba897baa already unused, calling callback (000000001cc62b0f) 00010000:00010000:1.0:1789135578.517650:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517658:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517678:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.517688:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135578.517717:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c5c9000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+11:3314:x1876044545003520:12345-0@lo:103: Request processed in 193us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135578.517725:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789135578.517753:0:6315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135578.517757:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f746b23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545003520:0@lo:103: 00010000:00010000:2.0:1789135578.517767:0:6315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135578.517774:0:6315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba897baa/0x5b09da6ee1ce3cf2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135578.828466:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135579.854319:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135580.876239:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135581.901488:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135582.924256:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135583.244227:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001365c176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545003776:0@lo:400: 00000100:00100000:2.0:1789135583.244239:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7963641 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545003648:0@lo:400: 00000100:00100000:2.0:1789135583.244369:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135583.244467:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545003648 00000100:00100000:0.0:1789135583.244475:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545003648 00000100:00100000:0.0:1789135583.244520:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135583.244528:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3b8d033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+11:3315:x1876044545003648:12345-0@lo:400: 00000100:00100000:0.0:1789135583.244579:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3b8d033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+11:3315:x1876044545003648:12345-0@lo:400: Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135583.244586:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135583.244627:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7963641 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545003648:0@lo:400: 00000100:00100000:3.0:1789135583.246204:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135583.246350:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545003776 00000100:00100000:0.0:1789135583.246358:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545003776 00000100:00100000:0.0:1789135583.246401:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135583.246407:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f72afb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545003776:12345-0@lo:400: 00000100:00100000:0.0:1789135583.246452:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f72afb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545003776:12345-0@lo:400: Request processed in 46us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135583.246459:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789135583.246913:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001365c176 x1876044545003776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135583.246927:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001365c176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545003776:0@lo:400: 00010000:00010000:2.0:1789135583.948577:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789135584.139245:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789135584.139249:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789135584.139408:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003626bb51 00000020:01000004:0.0:1789135584.139425:0:6677:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789135584.139435:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789135584.139454:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000017a5434) 00000020:00000080:0.0:1789135584.139468:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789135584.178349:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789135584.178620:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789135584.242542:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789135584.266591:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789135584.266625:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789135584.266684:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789135584.266709:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789135584.267118:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789135584.267129:0:6677:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789135584.267140:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b09da6ee1ce3d00 00000020:01000004:3.0:1789135584.267149:0:6677:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789135584.267169:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789135584.267173:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789135584.267179:0:6677:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789135584.267182:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789135584.267215:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000001dffb6cd) 00000020:00000080:3.0:1789135584.267227:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789135584.268336:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135584.268511:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789135584.268516:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789135584.272550:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789135584.272562:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789135584.284513:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789135584.284530:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789135584.289737:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135584.289991:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789135584.289998:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789135584.290946:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789135584.290955:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789135584.331625:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135584.331852:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789135584.331858:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789135584.338422:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789135584.338447:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789135584.339948:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789135584.339960:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789135584.348823:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135584.349015:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789135584.349020:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789135584.349746:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789135584.349754:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789135584.484821:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135584.485100:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789135584.485108:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789135584.488488:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789135584.488521:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789135584.489578:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789135584.489619:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789135584.489637:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789135584.527248:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789135584.527346:0:6677:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.135@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789135584.527351:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789135584.527352:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789135584.527354:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135584.527355:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135584.527356:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135584.527357:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135584.527359:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135584.527360:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135584.527362:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135584.527363:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135584.527364:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135584.527368:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789135584.527370:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789135584.527371:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789135584.527372:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135584.527373:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135584.527374:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135584.527375:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135584.527376:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135584.527377:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135584.527378:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135584.527379:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135584.527380:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135584.527412:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789135584.527430:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545003904:0@lo:253: 00000100:00100000:2.0:1789135584.527509:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.527562:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fccf0121 going to sleep for 11 seconds 00000100:00100000:0.0:1789135584.527591:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545003904 00000100:00100000:0.0:1789135584.527601:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545003904 00000100:00100000:0.0:1789135584.527650:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135584.527658:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b43e4cb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545003904:12345-0@lo:253: 20000000:01000000:0.0:1789135584.527685:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789135584.527689:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789135584.527693:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789135584.527696:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789135584.528706:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135584.528938:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789135584.528952:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789135584.528991:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789135584.528997:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789135584.529023:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789135584.529124:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789135584.529617:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789135584.529636:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.135@tcp 20000000:01000000:0.0:1789135584.529637:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:0.0:1789135584.529669:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789135584.529676:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789135584.529721:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789135584.529728:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:0.0:1789135584.529759:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789135584.529768:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789135584.529799:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789135584.529867:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789135584.531986:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789135584.532023:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.135@tcp 20000000:01000000:0.0:1789135584.532025:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:0.0:1789135584.532112:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789135584.532121:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789135584.532167:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789135584.532175:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:0.0:1789135584.532228:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789135584.532633:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789135584.532676:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789135584.532716:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789135584.532735:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789135584.532737:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789135584.532741:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789135584.532752:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789135584.532755:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789135584.532793:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789135584.532795:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789135584.534036:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789135584.534353:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789135584.534398:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789135584.534462:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1789135584.534477:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789135584.534479:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789135584.535326:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789135584.535379:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789135584.535431:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789135584.535726:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789135584.535776:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789135584.535811:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789135584.535823:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789135584.535825:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789135584.537290:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789135584.537353:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789135584.537411:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789135584.537791:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789135584.537870:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789135584.537927:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789135584.537943:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789135584.537945:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789135584.537953:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789135584.537968:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.537986:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.537992:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.537998:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.538005:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.538039:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.538097:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 11 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135584.538110:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000092f32c3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876044545004032:0@lo:104: 00000100:00100000:3.0:1789135584.538209:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135584.538317:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.538326:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 11 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135584.538333:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cc9a3aa pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876044545004160:0@lo:104: 00000100:00100000:3.0:1789135584.538366:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135584.539375:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.539386:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 11 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135584.539395:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000367f3490 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876044545004288:0@lo:104: 00000100:00100000:3.0:1789135584.539423:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135584.541125:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545004032 00000100:00100000:1.0:1789135584.541136:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545004032 00000100:00100000:1.0:1789135584.541182:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545004160 00000100:00100000:1.0:1789135584.541185:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545004160 00000100:00100000:1.0:1789135584.541223:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135584.541230:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001abf0990 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:5832:x1876044545004032:12345-0@lo:104: 00010000:00010000:1.0:1789135584.541244:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.541322:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135584.541327:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001abf0990 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:5832:x1876044545004032:12345-0@lo:104: Request processed in 99us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.541334:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135584.541362:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135584.541369:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e76405f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:5832:x1876044545004160:12345-0@lo:104: 00010000:00010000:1.0:1789135584.541376:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541398:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135584.541403:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.541430:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135584.541435:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e76405f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:5832:x1876044545004160:12345-0@lo:104: Request processed in 68us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.541441:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789135584.541460:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135584.541481:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ca73f868 already unused, calling callback (00000000ec300ad2) 10000000:00010000:2.0:1789135584.541500:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541508:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135584.541514:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135584.541519:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135584.541548:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541554:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135584.541567:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541573:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: 00000000ca73f868/0x5b09da6ee1ce3cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3cc1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135584.541586:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dd2768d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545004416:0@lo:103: 00010000:00010000:2.0:1789135584.541587:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135584.541588:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135584.541589:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135584.541618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.541696:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545004416 00000100:00100000:2.0:1789135584.541701:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545004416 00010000:00010000:1.0:1789135584.541708:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135584.541713:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541717:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 12 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.541719:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000585513af already unused, calling callback (00000000ec300ad2) 10000000:00010000:1.0:1789135584.541721:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.541726:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135584.541732:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.541737:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 10000000:01000000:1.0:1789135584.541738:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789135584.541743:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090ebd078 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+12:3313:x1876044545004416:12345-0@lo:103: 00010000:00010000:2.0:1789135584.541751:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135584.541752:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.541758:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135584.541760:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 12 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.541765:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541768:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 12 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.541778:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: 00000000585513af/0x5b09da6ee1ce3c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3c51 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541784:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135584.541787:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135584.541788:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135584.541789:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135584.541801:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d8aaa15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545004544:0@lo:103: 00000100:00100000:2.0:1789135584.541808:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090ebd078 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+12:3313:x1876044545004416:12345-0@lo:103: Request processed in 66us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135584.541814:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135584.541823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.541832:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545004544 00000100:00100000:2.0:1789135584.541835:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545004544 00010000:00010000:2.0:1789135584.541846:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 12 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.541863:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135584.541868:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f746b23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+12:3314:x1876044545004544:12345-0@lo:103: 00000100:00100000:1.0:1789135584.541872:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dd2768d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545004416:0@lo:103: 00010000:00010000:2.0:1789135584.541874:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135584.541877:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 12 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541883:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 12 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.541892:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135584.541894:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135584.541896:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135584.541920:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f746b23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+12:3314:x1876044545004544:12345-0@lo:103: Request processed in 52us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135584.541927:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135584.541931:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d8aaa15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545004544:0@lo:103: 00000100:00100000:3.0:1789135584.542157:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set 000000002cc53db6 going to sleep for 11 seconds 00010000:00010000:3.0:1789135584.542170:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fa4ec628/0x5b09da6ee1ce3cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3cba expref: 11 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135584.542179:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000092f32c3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876044545004032:0@lo:104: 00010000:00010000:3.0:1789135584.542185:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a637fab1/0x5b09da6ee1ce3c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c4a expref: 10 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135584.542192:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cc9a3aa pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876044545004160:0@lo:104: 00000100:00100000:1.0:1789135584.543455:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545004288 00000100:00100000:1.0:1789135584.543464:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545004288 00000100:00100000:1.0:1789135584.543494:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135584.543501:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af039f71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:5832:x1876044545004288:12345-0@lo:104: 00010000:00010000:1.0:1789135584.543512:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.543582:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135584.543587:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af039f71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:5832:x1876044545004288:12345-0@lo:104: Request processed in 89us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.543594:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135584.543666:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000367f3490 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876044545004288:0@lo:104: 00010000:00010000:3.0:1789135584.543691:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.543991:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135584.543997:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544018:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055621bd0 already unused, calling callback (00000000ec300ad2) 10000000:00010000:2.0:1789135584.544021:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544028:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135584.544034:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135584.544039:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135584.544151:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544158:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135584.544184:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544191:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: 0000000055621bd0/0x5b09da6ee1ce3c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3c35 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135584.544204:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b7c78fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545004672:0@lo:103: 00010000:00010000:2.0:1789135584.544208:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135584.544209:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135584.544211:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135584.544236:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.544311:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545004672 00000100:00100000:2.0:1789135584.544316:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545004672 00010000:00010000:2.0:1789135584.544332:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 10 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.544360:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135584.544374:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000367f3490 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+10:3315:x1876044545004672:12345-0@lo:103: 00010000:00010000:2.0:1789135584.544383:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135584.544388:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 10 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544398:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 10 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544411:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a1ac699c/0x5b09da6ee1ce3c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3c2e expref: 10 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544423:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544430:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544441:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544447:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544453:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544458:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544464:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001837bd0b already unused, calling callback (000000001cc62b0f) 00010000:00010000:2.0:1789135584.544466:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544480:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544494:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544502:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135584.544532:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000367f3490 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+9:3315:x1876044545004672:12345-0@lo:103: Request processed in 161us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135584.544538:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135584.544563:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b7c78fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545004672:0@lo:103: 00010000:00010000:2.0:1789135584.544579:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544585:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.544590:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001837bd0b/0x5b09da6ee1ce3d0e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789135584.544601:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789135584.611946:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b43e4cb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+8:6677:x1876044545003904:12345-0@lo:253: Request processed in 84282us (84430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.611963:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789135584.612143:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545003904:0@lo:253: 10000000:01000000:2.0:1789135584.612160:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789135584.612163:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789135584.612165:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789135584.612167:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135584.612168:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789135584.612169:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135584.612171:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135584.612179:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135584.612180:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789135584.612182:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135584.612183:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789135584.612201:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003626bb51 from lustre-OST0000 10000000:01000000:2.0:1789135584.612226:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789135584.612229:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789135584.612236:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adc06b64ed8 local copy 10000000:01000000:2.0:1789135584.612239:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789135584.612274:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.612285:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.612293:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.612312:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545004800:0@lo:101: 00000100:00100000:2.0:1789135584.612351:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.612405:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab288c14 going to sleep for 11 seconds 00000100:00100000:1.0:1789135584.612583:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545004800 00000100:00100000:1.0:1789135584.612589:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545004800 00000100:00100000:1.0:1789135584.612738:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135584.612747:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000963b1bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+8:6677:x1876044545004800:12345-0@lo:101: 00010000:00010000:1.0:1789135584.612759:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135584.612771:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da6ac380/0x5b09da6ee1ce3d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3d15 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.612791:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da6ac380/0x5b09da6ee1ce3d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d15 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.612800:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da6ac380/0x5b09da6ee1ce3d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d15 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.612810:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da6ac380, rc 0) 00000100:00100000:1.0:1789135584.612849:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000963b1bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+9:6677:x1876044545004800:12345-0@lo:101: Request processed in 104us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.612855:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789135584.612933:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545004800:0@lo:101: 00010000:00010000:2.0:1789135584.612944:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.612951:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.613097:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545004928:0@lo:501: 00000100:00100000:2.0:1789135584.613125:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.613568:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab288c14 going to sleep for 11 seconds 00000100:00100000:0.0:1789135584.613660:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545004928 00000100:00100000:0.0:1789135584.613666:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545004928 00000100:00100000:0.0:1789135584.613695:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135584.613702:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a6435ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+9:6677:x1876044545004928:12345-0@lo:501: 00000100:00100000:0.0:1789135584.613975:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a6435ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+9:6677:x1876044545004928:12345-0@lo:501: Request processed in 273us (849us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135584.613983:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789135584.614221:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545004928:0@lo:501: 10000000:01000000:2.0:1789135584.614237:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789135584.614268:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789135584.614274:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.614283:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.614288:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.614311:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789135584.614330:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adc057f3800 10000000:01000000:2.0:1789135584.614335:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789135584.614339:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8adc06b64ed8 10000000:01000000:2.0:1789135584.614342:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789135584.614345:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8adc06b64ed8 from 1 10000000:01000000:2.0:1789135584.614347:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789135584.614367:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000d04eb516/0x5b09da6ee1ce3d23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.614374:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000d04eb516/0x5b09da6ee1ce3d23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.614382:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000d04eb516/0x5b09da6ee1ce3d23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.614393:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005056:0@lo:101: 00000100:00100000:2.0:1789135584.614420:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.614456:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000939f3857 going to sleep for 11 seconds 00000100:00100000:0.0:1789135584.614513:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545005056 00000100:00100000:0.0:1789135584.614517:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545005056 00000100:00100000:0.0:1789135584.614547:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135584.614553:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002912933b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+9:6677:x1876044545005056:12345-0@lo:101: 00010000:00010000:0.0:1789135584.614567:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135584.614578:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a414425/0x5b09da6ee1ce3d2a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3d23 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.614597:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a414425/0x5b09da6ee1ce3d2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d23 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.614604:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a414425/0x5b09da6ee1ce3d2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d23 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.614611:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a414425, rc 0) 00000100:00100000:0.0:1789135584.614707:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002912933b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005056:12345-0@lo:101: Request processed in 154us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135584.614714:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1789135584.614818:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135584.614825:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.614832:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c57e974 already unused, calling callback (00000000ec300ad2) 10000000:00010000:1.0:1789135584.614835:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.614842:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135584.614848:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135584.614860:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135584.614877:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.614883:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135584.614909:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.614916:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: 000000009c57e974/0x5b09da6ee1ce3d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b09da6ee1ce3d1c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.614932:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135584.614934:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135584.614935:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135584.614943:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135584.614953:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d8aaa15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545005184:0@lo:103: 00000100:00100000:1.0:1789135584.614981:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135584.615009:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545005184 00000100:00100000:1.0:1789135584.615013:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545005184 00000100:00100000:1.0:1789135584.615061:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135584.615098:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012b58199 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+10:3315:x1876044545005184:12345-0@lo:103: 00010000:00010000:1.0:1789135584.615107:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135584.615117:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da6ac380/0x5b09da6ee1ce3d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d15 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.615128:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135584.615155:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012b58199 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+9:3315:x1876044545005184:12345-0@lo:103: Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.615173:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135584.615210:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d8aaa15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545005184:0@lo:103: 00000100:00100000:2.0:1789135584.615334:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005056:0@lo:101: 00010000:00010000:2.0:1789135584.615345:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000d04eb516/0x5b09da6ee1ce3d23 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d2a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.615353:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000d04eb516/0x5b09da6ee1ce3d23 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3d2a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135584.615367:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789135584.615383:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000d04eb516/0x5b09da6ee1ce3d23 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d2a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.615390:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000d04eb516/0x5b09da6ee1ce3d23 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d2a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135584.615397:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789135584.615401:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135584.615405:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789135584.615407:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789135584.615421:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 00000000109ad9fb/0x5b09da6ee1ce3d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.615428:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 00000000109ad9fb/0x5b09da6ee1ce3d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.615434:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 00000000109ad9fb/0x5b09da6ee1ce3d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.615445:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005312:0@lo:101: 00000100:00100000:2.0:1789135584.615469:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.615502:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000939f3857 going to sleep for 11 seconds 00000100:00100000:0.0:1789135584.615560:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545005312 00000100:00100000:0.0:1789135584.615565:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545005312 00000100:00100000:3.0:1789135584.616406:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135584.616420:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074e295ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+9:6677:x1876044545005312:12345-0@lo:101: 00010000:00010000:3.0:1789135584.616433:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135584.616446:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058f88bf1/0x5b09da6ee1ce3d38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3d31 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.616465:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058f88bf1/0x5b09da6ee1ce3d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.616473:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058f88bf1/0x5b09da6ee1ce3d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.616480:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058f88bf1, rc 0) 00000100:00100000:3.0:1789135584.616526:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074e295ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005312:12345-0@lo:101: Request processed in 111us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135584.616533:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789135584.617941:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005312:0@lo:101: 00010000:00010000:2.0:1789135584.617962:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 00000000109ad9fb/0x5b09da6ee1ce3d31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135584.617974:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 00000000109ad9fb/0x5b09da6ee1ce3d31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.618111:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005440:0@lo:501: 00000100:00100000:2.0:1789135584.618154:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.618295:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000939f3857 going to sleep for 11 seconds 00000100:00100000:3.0:1789135584.618335:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545005440 00000100:00100000:3.0:1789135584.618341:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545005440 00000100:00100000:3.0:1789135584.618425:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789135584.618434:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f299815 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005440:12345-0@lo:501: 00000100:00100000:3.0:1789135584.618787:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f299815 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005440:12345-0@lo:501: Request processed in 355us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135584.618795:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789135584.618862:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005440:0@lo:501: 00000100:00100000:2.0:1789135584.618892:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005568:0@lo:503: 00000100:00100000:2.0:1789135584.618933:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.619059:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000939f3857 going to sleep for 11 seconds 00000100:00100000:0.0:1789135584.619132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545005568 00000100:00100000:0.0:1789135584.619138:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545005568 00000100:00100000:0.0:1789135584.619164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135584.619170:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000231ee2bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005568:12345-0@lo:503: 00000100:00100000:0.0:1789135584.619415:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000231ee2bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005568:12345-0@lo:503: Request processed in 245us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135584.619423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135584.619595:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066060649 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005568:0@lo:503: 00000040:00080000:1.0:1789135584.619997:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789135584.620890:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d8aaa15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005696:0@lo:502: 00000100:00100000:1.0:1789135584.620951:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135584.621079:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d4491a2 going to sleep for 11 seconds 00000100:00100000:2.0:1789135584.621130:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545005696 00000100:00100000:2.0:1789135584.621136:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545005696 00000100:00100000:2.0:1789135584.621221:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789135584.621229:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000429b3ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005696:12345-0@lo:502: 00000100:00100000:2.0:1789135584.621441:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000429b3ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005696:12345-0@lo:502: Request processed in 212us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135584.621448:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789135584.621546:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d8aaa15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005696:0@lo:502: 00000040:00080000:1.0:1789135584.621946:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789135584.621997:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789135584.622054:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789135584.622187:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789135584.622226:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789135584.622279:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789135584.622305:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d8aaa15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005824:0@lo:502: 00000100:00100000:1.0:1789135584.622348:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135584.622438:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d4491a2 going to sleep for 11 seconds 00000100:00100000:3.0:1789135584.622474:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545005824 00000100:00100000:3.0:1789135584.622486:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545005824 00000100:00100000:3.0:1789135584.622560:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789135584.622566:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008205e0d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005824:12345-0@lo:502: 00000100:00100000:3.0:1789135584.622894:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008205e0d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005824:12345-0@lo:502: Request processed in 328us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135584.622902:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789135584.622993:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d8aaa15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005824:0@lo:502: 00000040:00080000:1.0:1789135584.623126:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789135584.623137:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789135584.623567:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789135584.623575:0:6696:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789135584.623582:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135584.623584:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789135584.623589:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789135584.623608:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000000a18afad) 00000020:00000080:1.0:1789135584.623757:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789135584.623770:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789135584.623874:0:6696:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003626bb51 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789135584.623880:0:6696:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789135584.623886:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b09da6ee1ce3d46 00010000:00010000:1.0:1789135584.627797:0:6696:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789135584.628427:0:6696:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789135584.630864:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789135584.631226:0:6696:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789135584.637410:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789135584.638030:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789135584.639379:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789135584.639392:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135584.639400:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135584.639402:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789135584.639407:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135584.639412:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135584.639413:0:6696:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135584.639417:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135584.639419:0:6696:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789135584.639460:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135584.639465:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135584.639467:0:6696:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789135584.639471:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789135584.639732:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789135584.639758:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789135584.639819:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: 00000000109ad9fb/0x5b09da6ee1ce3d31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.639832:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: 00000000109ad9fb/0x5b09da6ee1ce3d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135584.639840:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc057f3800 from 1 10000000:01000000:3.0:1789135584.639843:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135584.639875:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: 000000001837bd0b/0x5b09da6ee1ce3d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.639882:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: 000000001837bd0b/0x5b09da6ee1ce3d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.639892:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: 000000001837bd0b/0x5b09da6ee1ce3d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135584.639912:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cc9a3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005952:0@lo:101: 00000100:00100000:3.0:1789135584.639976:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135584.640037:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4fd9d24 going to sleep for 11 seconds 00000100:00100000:0.0:1789135584.640058:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545005952 00000100:00100000:0.0:1789135584.640087:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545005952 00000100:00100000:0.0:1789135584.640133:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789135584.640140:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d4b5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+10:6677:x1876044545005952:12345-0@lo:101: 00010000:00010000:0.0:1789135584.640153:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135584.640181:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca73f868/0x5b09da6ee1ce3d54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3d4d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.640269:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca73f868/0x5b09da6ee1ce3d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.640280:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca73f868/0x5b09da6ee1ce3d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.640288:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca73f868, rc 0) 00000100:00100000:0.0:1789135584.640330:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d4b5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545005952:12345-0@lo:101: Request processed in 190us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135584.640336:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789135584.640380:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cc9a3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545005952:0@lo:101: 00010000:00010000:3.0:1789135584.640403:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: 000000001837bd0b/0x5b09da6ee1ce3d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.640412:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: 000000001837bd0b/0x5b09da6ee1ce3d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135584.640488:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cc9a3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006080:0@lo:501: 00000100:00100000:3.0:1789135584.640513:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135584.640543:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4fd9d24 going to sleep for 11 seconds 00000100:00100000:1.0:1789135584.640592:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545006080 00000100:00100000:1.0:1789135584.640596:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545006080 00000100:00100000:1.0:1789135584.640784:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789135584.640792:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007943af12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006080:12345-0@lo:501: 00000100:00100000:1.0:1789135584.641021:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007943af12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006080:12345-0@lo:501: Request processed in 231us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.641029:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789135584.641109:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cc9a3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006080:0@lo:501: 00000100:00100000:0.0:1789135584.641140:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7963641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006208:0@lo:503: 00000100:00100000:0.0:1789135584.641176:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135584.641209:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbdd6fd6 going to sleep for 11 seconds 00000100:00100000:3.0:1789135584.641226:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545006208 00000100:00100000:3.0:1789135584.641232:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545006208 00000100:00100000:3.0:1789135584.641263:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135584.641270:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002228b817 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006208:12345-0@lo:503: 00000100:00100000:3.0:1789135584.641731:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002228b817 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006208:12345-0@lo:503: Request processed in 461us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135584.641741:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7963641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006208:0@lo:503: 00000100:00100000:3.0:1789135584.641742:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000040:00080000:0.0:1789135584.642100:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789135584.642181:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7963641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006336:0@lo:502: 00000100:00100000:0.0:1789135584.642225:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135584.642258:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbdd6fd6 going to sleep for 11 seconds 00000100:00100000:3.0:1789135584.642776:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545006336 00000100:00100000:3.0:1789135584.642783:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545006336 00000100:00100000:3.0:1789135584.642826:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789135584.642834:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000defc2a37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006336:12345-0@lo:502: 00000100:00100000:3.0:1789135584.644204:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000defc2a37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006336:12345-0@lo:502: Request processed in 1366us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135584.644217:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135584.644879:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7963641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006336:0@lo:502: 00000040:00080000:0.0:1789135584.645756:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789135584.645837:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789135584.645878:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7963641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006464:0@lo:502: 00000100:00100000:0.0:1789135584.645945:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135584.646005:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbdd6fd6 going to sleep for 11 seconds 00000100:00100000:3.0:1789135584.646015:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545006464 00000100:00100000:3.0:1789135584.646025:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545006464 00000100:00100000:3.0:1789135584.646181:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789135584.646191:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cb8a31b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006464:12345-0@lo:502: 00000100:00100000:3.0:1789135584.646401:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cb8a31b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006464:12345-0@lo:502: Request processed in 211us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135584.646410:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789135584.646503:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7963641 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006464:0@lo:502: 00000040:00080000:0.0:1789135584.646675:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789135584.646754:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789135584.647420:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135584.647430:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135584.647438:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789135584.647445:0:6700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc057f3800 00000020:00000080:3.0:1789135584.647447:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135584.647484:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135584.647488:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135584.647490:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789135584.647493:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789135584.647649:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789135584.647669:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135584.647750:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.647761:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135584.647800:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789135584.647803:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adc057f3800 10000000:01000000:0.0:1789135584.647807:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adc057f3800 10000000:01000000:0.0:1789135584.647810:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789135584.647816:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc057f3800 from 1 10000000:01000000:0.0:1789135584.647819:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789135584.647845:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.647853:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.647862:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135584.647879:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006592:0@lo:101: 00000100:00100000:0.0:1789135584.647925:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135584.647966:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc10a9fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135584.647971:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545006592 00000100:00100000:3.0:1789135584.647977:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545006592 00000100:00100000:3.0:1789135584.648018:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789135584.648029:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545006592:12345-0@lo:101: 00010000:00010000:3.0:1789135584.648053:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135584.648090:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3d5b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.648116:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.648127:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.648138:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e5600, rc 0) 00000100:00100000:3.0:1789135584.648188:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545006592:12345-0@lo:101: Request processed in 160us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135584.648195:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789135584.648533:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006592:0@lo:101: 00010000:00010000:0.0:1789135584.648546:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.648555:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135584.648654:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006720:0@lo:501: 00000100:00100000:0.0:1789135584.648679:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135584.648825:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc10a9fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135584.648865:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545006720 00000100:00100000:1.0:1789135584.648877:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545006720 00000100:00100000:1.0:1789135584.648941:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135584.648968:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545006720:12345-0@lo:501: 00000100:00100000:1.0:1789135584.649272:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545006720:12345-0@lo:501: Request processed in 305us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.649280:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789135584.649308:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006720:0@lo:501: 00000100:00100000:2.0:1789135584.649380:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006848:0@lo:503: 00000100:00100000:2.0:1789135584.649426:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.649458:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135584.649521:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545006848 00000100:00100000:3.0:1789135584.649526:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545006848 00000100:00100000:3.0:1789135584.649549:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789135584.649554:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545006848:12345-0@lo:503: 00000100:00100000:3.0:1789135584.649689:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545006848:12345-0@lo:503: Request processed in 134us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135584.649696:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789135584.649742:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006848:0@lo:503: 00000040:00080000:2.0:1789135584.650010:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135584.650089:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006976:0@lo:502: 00000100:00100000:2.0:1789135584.650126:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.650221:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135584.650254:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545006976 00000100:00100000:0.0:1789135584.650258:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545006976 00000100:00100000:0.0:1789135584.650283:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789135584.650290:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545006976:12345-0@lo:502: 00000100:00100000:0.0:1789135584.650495:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545006976:12345-0@lo:502: Request processed in 204us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135584.650503:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789135584.650571:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545006976:0@lo:502: 00000040:00080000:2.0:1789135584.650833:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789135584.650879:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789135584.650912:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789135584.650956:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789135584.650998:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789135584.651088:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789135584.651139:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789135584.651177:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789135584.651232:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789135584.651273:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789135584.651321:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789135584.651379:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789135584.651425:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789135584.651463:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789135584.651522:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789135584.651562:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789135584.651619:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789135584.651687:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789135584.651732:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789135584.651789:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789135584.651838:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789135584.651873:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789135584.651926:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789135584.651975:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789135584.652020:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789135584.652126:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789135584.652190:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789135584.652279:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789135584.652317:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545007104:0@lo:502: 00000100:00100000:2.0:1789135584.652379:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135584.652412:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135584.653137:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545007104 00000100:00100000:3.0:1789135584.653145:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545007104 00000100:00100000:3.0:1789135584.653195:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789135584.653204:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545007104:12345-0@lo:502: 00000100:00100000:3.0:1789135584.653416:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545007104:12345-0@lo:502: Request processed in 213us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135584.653425:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789135584.653449:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545007104:0@lo:502: 00000040:00080000:2.0:1789135584.653531:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789135584.653542:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789135584.655262:0:6701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789135584.655276:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8adc04788000) 00000020:00000080:0.0:1789135584.655295:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789135584.655387:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc057f3800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789135584.655391:0:6701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc057f3800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789135584.655393:0:6701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc057f3800 3 00010000:00080000:0.0:1789135584.655420:0:6701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adc057f6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1789135584.659495:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789135584.659716:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789135584.659916:0:6701:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789135584.659928:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5b09da6ee1ce3d70 00000100:00080000:1.0:1789135584.659937:0:6701:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135584.659943:0:6701:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc057f6000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1789135584.659973:0:6701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc156f6940 x1876044545007232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135584.659996:0:6701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789135584.660087:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044545007232:0@lo:38: 00000100:00100000:0.0:1789135584.660177:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135584.660211:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545007232 00000100:00100000:1.0:1789135584.660218:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545007232 00000100:00100000:1.0:1789135584.660246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135584.660253:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1876044545007232:12345-0@lo:38: 00010000:00080000:1.0:1789135584.660273:0:5837:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1789135584.660303:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5b09da6ee1ce3d77 00000004:00100000:1.0:1789135584.660329:0:5837:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789135584.660356:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8adb01f6e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135584.660410:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044545007232:12345-0@lo:38: Request processed in 156us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.660417:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789135584.660462:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc156f6940 x1876044545007232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135584.660490:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135584.660498:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789135584.660504:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789135584.660508:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789135584.660518:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc057f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789135584.660526:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044545007232:0@lo:38: 00000040:00080000:1.0:1789135584.660550:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1789135584.661432:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545007360:0@lo:400: 00000100:00100000:1.0:1789135584.661469:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135584.661842:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545007360 00000100:00100000:1.0:1789135584.661907:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545007360 00000100:00100000:1.0:1789135584.661976:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135584.661983:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545007360:12345-0@lo:400: 00000100:00100000:1.0:1789135584.662028:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545007360:12345-0@lo:400: Request processed in 45us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.662034:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789135584.662214:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc19454b40 x1876044545007360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135584.662226:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545007360:0@lo:400: 00000020:01000000:3.0:1789135584.663126:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789135584.663172:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135584.663189:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135584.663199:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789135584.663245:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789135584.663247:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135584.663248:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135584.663250:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135584.663251:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135584.663252:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135584.663253:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135584.663255:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135584.663257:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135584.663263:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135584.663264:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135584.663268:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789135584.663275:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135584.663276:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135584.663277:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135584.663278:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135584.663279:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135584.663280:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135584.663281:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135584.663282:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135584.663283:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135584.663284:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135584.663285:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135584.663310:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789135584.663333:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194561c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545007488:0@lo:253: 00000100:00100000:3.0:1789135584.663377:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135584.663412:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc10a9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135584.663441:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545007488 00000100:00100000:0.0:1789135584.663455:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545007488 00000100:00100000:0.0:1789135584.663500:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789135584.663509:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:6677:x1876044545007488:12345-0@lo:253: 20000000:01000000:0.0:1789135584.663531:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789135584.663552:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789135584.728357:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789135584.728414:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789135584.732556:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789135584.732565:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789135584.732586:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.732604:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc029e5400/0x5b09da6ee1ce3ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.732612:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.732662:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc029e5400/0x5b09da6ee1ce3ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.732676:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc029e5400/0x5b09da6ee1ce3ceb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 12 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135584.732707:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194efc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1876044545007616:0@lo:104: 00000100:00100000:0.0:1789135584.732766:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135584.732819:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc032123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135584.732884:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545007616 00000100:00100000:1.0:1789135584.732892:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545007616 00000100:00100000:1.0:1789135584.732938:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135584.732948:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:5852:x1876044545007616:12345-0@lo:104: 00010000:00010000:1.0:1789135584.732961:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc00031a00/0x5b09da6ee1ce3ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733166:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135584.733173:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:5852:x1876044545007616:12345-0@lo:104: Request processed in 228us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.733181:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789135584.733288:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194efc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1876044545007616:0@lo:104: 00010000:00010000:0.0:1789135584.733307:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733432:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135584.733438:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc00031a00/0x5b09da6ee1ce3ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733459:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031a00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135584.733463:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc00031a00/0x5b09da6ee1ce3ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733472:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc00031a00/0x5b09da6ee1ce3ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135584.733479:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc00031a00/0x5b09da6ee1ce3ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135584.733485:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135584.733523:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc00031a00/0x5b09da6ee1ce3ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733529:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135584.733547:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc00031a00/0x5b09da6ee1ce3ce4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733554:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc00031a00/0x5b09da6ee1ce3ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ceb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733570:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135584.733572:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135584.733573:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135584.733584:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545007744:0@lo:103: 00000100:00100000:1.0:1789135584.733615:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135584.733656:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545007744 00000100:00100000:1.0:1789135584.733660:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545007744 00010000:00010000:1.0:1789135584.733676:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc029e5400/0x5b09da6ee1ce3ceb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 13 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135584.733703:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135584.733710:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc076c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+13:3314:x1876044545007744:12345-0@lo:103: 00010000:00010000:1.0:1789135584.733720:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135584.733725:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc029e5400/0x5b09da6ee1ce3ceb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 13 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733734:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc029e5400/0x5b09da6ee1ce3ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 13 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733747:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e5400/0x5b09da6ee1ce3ceb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ce4 expref: 13 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733759:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733765:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789135584.733776:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002690794s 00010000:00010000:1.0:1789135584.733781:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733788:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733794:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733801:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733812:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135584.733816:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733823:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733835:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135584.733843:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135584.733869:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc076c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+12:3314:x1876044545007744:12345-0@lo:103: Request processed in 160us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135584.733875:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135584.733926:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545007744:0@lo:103: 00010000:00010000:0.0:1789135584.734088:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.734097:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135584.734103:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3d7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135584.736814:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+11:6677:x1876044545007488:12345-0@lo:253: Request processed in 73298us (73427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135584.736828:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135584.736901:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194561c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:6677:1876044545007488:0@lo:253: 10000000:01000000:3.0:1789135584.736915:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789135584.736918:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135584.736919:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135584.736921:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135584.736922:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135584.736923:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135584.736925:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135584.736926:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135584.736928:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135584.736929:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135584.736931:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135584.736932:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789135584.736946:0:6677:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789135584.742501:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789135584.742717:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789135584.742912:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789135584.743345:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789135584.743605:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789135584.743911:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789135584.745857:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789135584.914848:0:6677:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789135584.914855:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789135584.914886:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789135584.914935:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789135584.914951:0:6677:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789135584.915050:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789135584.972409:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789135585.615711:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789135585.615719:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc10b30000 from 21 10000000:01000000:2.0:1789135585.615738:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135585.615781:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.615793:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.615804:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135585.615839:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545007872:0@lo:101: 00000100:00100000:2.0:1789135585.615910:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.616101:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12c7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135585.618852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545007872 00000100:00100000:3.0:1789135585.618865:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545007872 00000100:00100000:3.0:1789135585.618996:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789135585.619006:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+11:5834:x1876044545007872:12345-0@lo:101: 00010000:00010000:3.0:1789135585.619021:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135585.619049:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.619107:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.619119:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.619127:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e5800, rc 0) 00000100:00100000:3.0:1789135585.619204:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545007872:12345-0@lo:101: Request processed in 200us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.619211:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135585.619551:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545007872:0@lo:101: 00010000:00010000:2.0:1789135585.619580:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.619591:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135585.619673:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008000:0@lo:501: 00000100:00100000:2.0:1789135585.619709:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.619754:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12c7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135585.620273:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545008000 00000100:00100000:3.0:1789135585.620281:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545008000 00000100:00100000:3.0:1789135585.620333:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789135585.620340:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545008000:12345-0@lo:501: 00000100:00100000:3.0:1789135585.620923:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545008000:12345-0@lo:501: Request processed in 581us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.620933:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135585.621972:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008000:0@lo:501: 00000100:00100000:2.0:1789135585.622034:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008128:0@lo:503: 00000100:00100000:2.0:1789135585.622135:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.622172:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12c7ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135585.622340:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545008128 00000100:00100000:3.0:1789135585.622347:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545008128 00000100:00100000:3.0:1789135585.622413:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789135585.622423:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545008128:12345-0@lo:503: 00000100:00100000:3.0:1789135585.623021:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545008128:12345-0@lo:503: Request processed in 599us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.623030:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135585.623539:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008128:0@lo:503: 00000100:00100000:2.0:1789135585.626659:0:6756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6756:1876044545008256:0@lo:502: 00000100:00100000:2.0:1789135585.626758:0:6756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.626806:0:6756:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12c7ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135585.626911:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545008256 00000100:00100000:3.0:1789135585.626918:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545008256 00000100:00100000:3.0:1789135585.626965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135585.626974:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:6756:x1876044545008256:12345-0@lo:502: 00000100:00100000:3.0:1789135585.627272:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:6756:x1876044545008256:12345-0@lo:502: Request processed in 298us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.627280:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789135585.627529:0:6756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6756:1876044545008256:0@lo:502: 00000100:00100000:2.0:1789135585.627590:0:6756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6756:1876044545008384:0@lo:502: 00000100:00100000:2.0:1789135585.627631:0:6756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.627660:0:6756:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135585.627698:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545008384 00000100:00100000:3.0:1789135585.627702:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545008384 00000100:00100000:3.0:1789135585.627730:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135585.627736:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:6756:x1876044545008384:12345-0@lo:502: 00000100:00100000:3.0:1789135585.627874:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:6756:x1876044545008384:12345-0@lo:502: Request processed in 137us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.627881:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789135585.628145:0:6756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6756:1876044545008384:0@lo:502: 00000040:00080000:2.0:1789135585.628166:0:6756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789135585.628521:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789135585.628538:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135585.628547:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.628558:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135585.628567:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789135585.628577:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc10b30000 from 4 10000000:01000000:3.0:1789135585.628579:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789135585.628608:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.628615:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.628622:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135585.628635:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008512:0@lo:101: 00000100:00100000:3.0:1789135585.628664:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135585.628695:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc079f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.628749:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545008512 00000100:00100000:1.0:1789135585.628754:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545008512 00000100:00100000:1.0:1789135585.628792:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135585.628800:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545008512:12345-0@lo:101: 00010000:00010000:1.0:1789135585.628810:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135585.628823:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3d93 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.628845:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.628855:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.628874:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480400, rc 0) 00000100:00100000:1.0:1789135585.628905:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545008512:12345-0@lo:101: Request processed in 106us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.628911:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789135585.629059:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008512:0@lo:101: 00010000:00010000:3.0:1789135585.629097:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.629106:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135585.629153:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008640:0@lo:256: 00000100:00100000:3.0:1789135585.629182:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135585.629201:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc079f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.629510:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545008640 00000100:00100000:1.0:1789135585.629515:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545008640 00000100:00100000:1.0:1789135585.629548:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135585.629554:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545008640:12345-0@lo:256: 20000000:01000000:1.0:1789135585.629567:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789135585.629587:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789135585.629590:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789135585.629675:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545008640:12345-0@lo:256: Request processed in 120us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.629683:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135585.629756:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008640:0@lo:256: 10000000:01000000:2.0:1789135585.629808:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789135585.629816:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.629824:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135585.629831:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789135585.629833:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789135585.629835:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789135585.629857:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.629865:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.629872:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135585.629884:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008768:0@lo:101: 00000100:00100000:2.0:1789135585.629913:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.630272:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135585.630340:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545008768 00000100:00100000:3.0:1789135585.630345:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545008768 00000100:00100000:3.0:1789135585.630384:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789135585.630392:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545008768:12345-0@lo:101: 00010000:00010000:3.0:1789135585.630402:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135585.630424:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3da1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.630456:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.630467:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135585.630476:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e4a00, rc 0) 00000100:00100000:3.0:1789135585.630512:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545008768:12345-0@lo:101: Request processed in 121us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.630518:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789135585.630876:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008768:0@lo:101: 00010000:00010000:2.0:1789135585.630899:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.630910:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135585.630964:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008896:0@lo:501: 00000100:00100000:2.0:1789135585.630995:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.631019:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135585.633366:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545008896 00000100:00100000:3.0:1789135585.633380:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545008896 00000100:00100000:3.0:1789135585.633439:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789135585.633448:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545008896:12345-0@lo:501: 00000100:00100000:3.0:1789135585.633750:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545008896:12345-0@lo:501: Request processed in 292us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.633759:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789135585.633932:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545008896:0@lo:501: 00000100:00100000:2.0:1789135585.633981:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545009024:0@lo:503: 00000100:00100000:2.0:1789135585.634028:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.634102:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.634152:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545009024 00000100:00100000:1.0:1789135585.634157:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545009024 00000100:00100000:1.0:1789135585.634185:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789135585.634192:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545009024:12345-0@lo:503: 00000100:00100000:1.0:1789135585.634793:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545009024:12345-0@lo:503: Request processed in 600us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.634801:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135585.634946:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545009024:0@lo:503: 00000100:00100000:3.0:1789135585.635546:0:6757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19457480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6757:1876044545009152:0@lo:502: 00000100:00100000:3.0:1789135585.635601:0:6757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135585.635638:0:6757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1fd5df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.636016:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545009152 00000100:00100000:1.0:1789135585.636022:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545009152 00000100:00100000:1.0:1789135585.636093:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789135585.636102:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:6757:x1876044545009152:12345-0@lo:502: 00000100:00100000:1.0:1789135585.636338:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:6757:x1876044545009152:12345-0@lo:502: Request processed in 237us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.636351:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789135585.636352:0:6757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19457480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6757:1876044545009152:0@lo:502: 00000020:01000000:3.0:1789135585.636381:0:6757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789135585.636388:0:6757:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789135585.636395:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135585.636397:0:6757:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789135585.636409:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789135585.636412:0:6757:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.135@tcp to nid 0x20000c0a8ce87 (192.168.206.135@tcp) 00000020:01000000:3.0:1789135585.636448:0:6757:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789135585.636451:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135585.636465:0:6757:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8adc41701a48) 00000020:00000080:3.0:1789135585.636496:0:6757:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789135585.636501:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789135585.636568:0:6757:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789135585.636573:0:6757:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789135585.636579:0:6757:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce3db6 00010000:00080000:3.0:1789135585.636604:0:6757:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adc076d4000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:3.0:1789135585.636826:0:6757:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789135585.690438:0:6757:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789135585.690459:0:6757:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789135585.691101:0:6757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135585.691312:0:6757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135585.691375:0:6757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789135585.691453:0:6757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789135585.691890:0:6762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135585.691895:0:6762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789135585.692640:0:6757:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789135585.692649:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789135585.692672:0:6757:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789135585.692695:0:6757:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce3dbd 00000100:00080000:3.0:1789135585.692703:0:6757:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789135585.692709:0:6757:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adc076d4000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135585.692735:0:6757:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc19457480 x1876044545009280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789135585.692781:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545009280:0@lo:8: 00000100:00100000:0.0:1789135585.692840:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789135585.692910:0:6757:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789135585.692964:0:6757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135585.692968:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135585.692970:0:6757:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789135585.692979:0:6757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135585.692983:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135585.692985:0:6757:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789135585.692988:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789135585.692989:0:6757:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789135585.693011:0:6757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6757:1876044545009408:0@lo:502: 00000100:00100000:3.0:1789135585.693084:0:6757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135585.693117:0:6757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1fd5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.693286:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545009408 00000100:00100000:1.0:1789135585.693292:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545009408 00000100:00100000:1.0:1789135585.693336:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789135585.693509:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545009280 00000100:00100000:2.0:1789135585.693515:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545009280 00000100:00100000:2.0:1789135585.693548:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135585.693556:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1876044545009280:12345-0@lo:8: 00000100:00100000:0.0:1789135585.693556:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789135585.693568:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1789135585.693585:0:6680:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1789135585.693612:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce3dc4 00000100:00100000:1.0:1789135585.693624:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:6757:x1876044545009408:12345-0@lo:502: 00002000:00100000:2.0:1789135585.693644:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8adc0579d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113983 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789135585.693650:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789135585.693654:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789135585.693811:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789135585.693941:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:6757:x1876044545009408:12345-0@lo:502: Request processed in 595us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.693949:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00002000:00080000:2.0:1789135585.694016:0:6680:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789135585.694092:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8adc05798000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135585.694146:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044545009280:12345-0@lo:8: Request processed in 588us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135585.694154:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135585.694219:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545009536:0@lo:400: 00000100:00100000:1.0:1789135585.694253:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.694283:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135585.694289:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545009664:0@lo:400: 00000100:00100000:1.0:1789135585.694316:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789135585.694345:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc19457480 x1876044545009280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135585.694349:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545009536 00000100:00100000:1.0:1789135585.694356:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545009536 00000100:00100000:2.0:1789135585.694360:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789135585.694369:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789135585.694377:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789135585.694383:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:1.0:1789135585.694383:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545009664 00000100:00080000:2.0:1789135585.694386:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc076d4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789135585.694388:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545009664 00000004:00080000:2.0:1789135585.694412:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789135585.694417:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000004:00080000:0.0:1789135585.694421:0:6762:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789135585.694422:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545009280:0@lo:8: 00000100:00100000:1.0:1789135585.694428:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545009536:12345-0@lo:400: 00000100:00100000:1.0:1789135585.694472:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545009536:12345-0@lo:400: Request processed in 47us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.694479:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789135585.694493:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc1954ed00 x1876044545009536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135585.694500:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135585.694510:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545009664:12345-0@lo:400: 00000004:00080000:0.0:1789135585.694510:0:6762:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 209266446928ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789135585.694513:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545009536:0@lo:400: 00000100:00100000:1.0:1789135585.694550:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545009664:12345-0@lo:400: Request processed in 41us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.694567:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789135585.694568:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc1954cb40 x1876044545009664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135585.694581:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545009664:0@lo:400: 00000100:00080000:1.0:1789135585.694685:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135585.694750:0:6757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6757:1876044545009408:0@lo:502: 00000020:01000000:3.0:1789135585.694773:0:6757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135585.694779:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135585.694781:0:6757:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789135585.694785:0:6757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789135585.694940:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789135585.694959:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789135585.694968:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.694979:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135585.694988:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135585.694992:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc10b30000 from 1 10000000:01000000:1.0:1789135585.694995:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135585.695020:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.695029:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.695051:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135585.695166:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545009792:0@lo:101: 00000100:00100000:1.0:1789135585.695202:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.695227:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.695242:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545009792 00000100:00100000:1.0:1789135585.695246:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545009792 00000100:00100000:1.0:1789135585.695271:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789135585.695279:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545009792:12345-0@lo:101: 00010000:00010000:1.0:1789135585.695294:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135585.695307:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3dcb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.695327:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.695338:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.695346:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480800, rc 0) 00000100:00100000:1.0:1789135585.695375:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545009792:12345-0@lo:101: Request processed in 97us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.695382:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789135585.695422:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545009792:0@lo:101: 00010000:00010000:1.0:1789135585.695434:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.695442:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135585.695479:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545009920:0@lo:501: 00000100:00100000:1.0:1789135585.695501:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.695513:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.695523:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545009920 00000100:00100000:1.0:1789135585.695526:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545009920 00000100:00100000:1.0:1789135585.695543:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789135585.695549:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545009920:12345-0@lo:501: 00000100:00100000:1.0:1789135585.695720:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545009920:12345-0@lo:501: Request processed in 170us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.695726:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789135585.695758:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545009920:0@lo:501: 00000100:00100000:1.0:1789135585.695781:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545010048:0@lo:503: 00000100:00100000:1.0:1789135585.695812:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.695824:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.695836:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545010048 00000100:00100000:1.0:1789135585.695839:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545010048 00000100:00100000:1.0:1789135585.695858:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135585.695864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545010048:12345-0@lo:503: 00000100:00100000:1.0:1789135585.696154:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545010048:12345-0@lo:503: Request processed in 288us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.696161:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789135585.696226:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545010048:0@lo:503: 00000100:00100000:1.0:1789135585.696497:0:6766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6766:1876044545010176:0@lo:502: 00000100:00100000:1.0:1789135585.696534:0:6766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.696576:0:6766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135585.696578:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545010176 00000100:00100000:3.0:1789135585.696591:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545010176 00000100:00100000:3.0:1789135585.696622:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789135585.696632:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:6766:x1876044545010176:12345-0@lo:502: 00000100:00100000:3.0:1789135585.696884:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:6766:x1876044545010176:12345-0@lo:502: Request processed in 254us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.696892:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789135585.696975:0:6766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6766:1876044545010176:0@lo:502: 00000020:01000000:2.0:1789135585.697002:0:6766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135585.697012:0:6766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135585.697015:0:6766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789135585.697021:0:6766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc10b30000 00000020:00000080:2.0:1789135585.697026:0:6766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135585.697199:0:6766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6766:1876044545010304:0@lo:502: 00000100:00100000:2.0:1789135585.697321:0:6766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.697359:0:6766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.697376:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545010304 00000100:00100000:1.0:1789135585.697382:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545010304 00000100:00100000:1.0:1789135585.697420:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789135585.697429:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+15:6766:x1876044545010304:12345-0@lo:502: 00000100:00100000:1.0:1789135585.697554:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+15:6766:x1876044545010304:12345-0@lo:502: Request processed in 127us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.697590:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789135585.697810:0:6766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:6766:1876044545010304:0@lo:502: 00000020:01000000:3.0:1789135585.697835:0:6766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135585.697841:0:6766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135585.697843:0:6766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789135585.697847:0:6766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789135585.698023:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789135585.698489:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135585.698504:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.698514:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135585.698523:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789135585.698525:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adc06b64ed8 from 1 10000000:01000000:1.0:1789135585.698527:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789135585.698552:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.698564:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135585.698573:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135585.698587:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545010432:0@lo:101: 00000100:00100000:1.0:1789135585.698623:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.698656:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135585.698791:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545010432 00000100:00100000:2.0:1789135585.698797:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545010432 00000100:00100000:2.0:1789135585.698836:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789135585.698845:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545010432:12345-0@lo:101: 00010000:00010000:2.0:1789135585.698856:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135585.698870:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3dd9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.698904:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.698915:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.698922:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2a00, rc 0) 00000100:00100000:2.0:1789135585.698967:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545010432:12345-0@lo:101: Request processed in 123us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135585.698974:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789135585.699016:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545010432:0@lo:101: 00010000:00010000:2.0:1789135585.699030:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135585.699615:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135585.699673:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545010560:0@lo:501: 00000100:00100000:2.0:1789135585.699715:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135585.699746:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.700365:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545010560 00000100:00100000:1.0:1789135585.700371:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545010560 00000100:00100000:1.0:1789135585.700400:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135585.700408:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545010560:12345-0@lo:501: 00000100:00100000:1.0:1789135585.700737:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545010560:12345-0@lo:501: Request processed in 329us (1020us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135585.700745:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789135585.700958:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545010560:0@lo:501: 10000000:01000000:0.0:1789135585.700992:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789135585.701005:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135585.701015:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135585.782792:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789135585.783757:0:6763:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789135585.783782:0:6763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876044545010816:0@lo:7: 00000100:00100000:1.0:1789135585.783853:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.783905:0:6763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.783927:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545010688:0@lo:13: 00000100:00100000:1.0:1789135585.783967:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135585.784088:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545010816 00000100:00100000:3.0:1789135585.784096:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545010816 00000100:00100000:3.0:1789135585.784154:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135585.784171:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1876044545010816:12345-0@lo:7: 00000100:00080000:1.0:1789135585.785644:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135585.788117:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545010688 00000100:00100000:2.0:1789135585.788129:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545010688 00000100:00100000:2.0:1789135585.788687:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135585.788700:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044545010688:12345-0@lo:13: 00002000:00000024:2.0:1789135585.788724:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1789135585.788801:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044545010688:12345-0@lo:13: Request processed in 104us (4832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135585.788808:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789135585.789461:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc156f5e00 x1876044545010688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135585.789484:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545010688:0@lo:13: 00002000:00080000:3.0:1789135585.800571:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789135585.800581:0:6682:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789135585.800869:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1876044545010816:12345-0@lo:7: Request processed in 16696us (17011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135585.800881:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789135585.801094:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc156f52c0 x1876044545010816/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789135601 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135585.801110:0:6763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876044545010816:0@lo:7: 00000004:00080000:1.0:1789135585.801124:0:6763:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789135585.801220:0:6763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876044545010944:0@lo:5: 00000100:00100000:1.0:1789135585.801253:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.801289:0:6763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135585.801373:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545010944 00000100:00100000:1.0:1789135585.801379:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545010944 00000100:00100000:1.0:1789135585.801419:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135585.801427:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6763:x1876044545010944:12345-0@lo:5: 00002000:00080000:1.0:1789135585.801451:0:6680:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789135585.801455:0:6680:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789135585.801819:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6763:x1876044545010944:12345-0@lo:5: Request processed in 391us (564us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789135585.801827:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789135585.801865:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc156f52c0 x1876044545010944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135601 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135585.801893:0:6763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876044545010944:0@lo:5: 00000004:00080000:1.0:1789135585.801901:0:6763:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789135585.801925:0:6763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f6580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876044545011072:0@lo:700: 00000100:00100000:1.0:1789135585.802290:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135585.802425:0:6763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135585.806270:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545011072 00000100:00100000:0.0:1789135585.806283:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545011072 00000100:00100000:0.0:1789135585.806666:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135585.806677:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6763:x1876044545011072:12345-0@lo:700: 00000100:00100000:0.0:1789135585.806730:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ec780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1876044545011200:0@lo:700: 00000100:00100000:0.0:1789135585.806829:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135585.806864:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135585.808096:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545011200 00000100:00100000:2.0:1789135585.808105:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545011200 00000100:00100000:2.0:1789135585.808161:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135585.808171:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1876044545011200:12345-0@lo:700: 40000000:02000000:2.0:1789135585.880723:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789135585.896218:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1876044545011200:12345-0@lo:700: Request processed in 88042us (89382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135585.896232:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789135585.897627:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc194ec780 x1876044545011200/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789135601 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135585.897643:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ec780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1876044545011200:0@lo:700: 40000000:02000000:0.0:1789135585.897658:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:3.0:1789135585.997632:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789135585.998782:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789135585.998795:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789135585.998923:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6763:x1876044545011072:12345-0@lo:700: Request processed in 192245us (196965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135585.998942:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789135585.999031:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc156f6580 x1876044545011072/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789135601 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135585.999054:0:6763:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789135585.999413:0:6763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f6580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876044545011072:0@lo:700: 00000004:02000040:0.0:1789135586.127084:0:6763:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789135586.143710:0:6763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ec780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876044545011328:0@lo:5: 00000100:00100000:0.0:1789135586.143776:0:6763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135586.143859:0:6763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135586.157754:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545011328 00000100:00100000:3.0:1789135586.157767:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545011328 00000100:00100000:3.0:1789135586.157952:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135586.157962:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6763:x1876044545011328:12345-0@lo:5: 00002000:00080000:3.0:1789135586.183423:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789135586.183444:0:6682:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789135586.192578:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6763:x1876044545011328:12345-0@lo:5: Request processed in 34611us (48794us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789135586.192592:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789135586.193715:0:6763:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc194ec780 x1876044545011328/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135602 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135586.193735:0:6763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ec780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6763:1876044545011328:0@lo:5: 00000004:00080000:0.0:1789135586.193749:0:6763:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1789135587.020392:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135588.048863:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135589.069345:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135590.092728:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135590.926227:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545011456:0@lo:400: 00000100:00100000:2.0:1789135590.926307:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135590.926353:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135590.926360:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545011840:0@lo:400: 00000100:00100000:2.0:1789135590.926387:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135590.926438:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545011584:0@lo:400: 00000100:00100000:2.0:1789135590.926467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135590.926486:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135590.926492:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545011712:0@lo:400: 00000100:00100000:2.0:1789135590.926513:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135590.926541:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545011456 00000100:00100000:2.0:1789135590.926548:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545011456 00000100:00100000:2.0:1789135590.926588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789135590.926597:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:3314:x1876044545011456:12345-0@lo:400: 00000100:00100000:2.0:1789135590.926645:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:3314:x1876044545011456:12345-0@lo:400: Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135590.926652:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789135590.926680:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545011840 00000100:00100000:2.0:1789135590.926684:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545011840 00000100:00100000:2.0:1789135590.926718:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135590.926725:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044545011840:12345-0@lo:400: 00000100:00100000:2.0:1789135590.926756:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044545011840:12345-0@lo:400: Request processed in 31us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135590.926762:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135590.926779:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545011584 00000100:00100000:2.0:1789135590.926783:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545011584 00000100:00100000:2.0:1789135590.926805:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545011712 00000100:00100000:2.0:1789135590.926808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545011712 00000100:00100000:2.0:1789135590.926822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135590.926827:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545011584:12345-0@lo:400: 00000100:00100000:2.0:1789135590.926861:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545011584:12345-0@lo:400: Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135590.926868:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135590.926887:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789135590.926894:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545011712:12345-0@lo:400: 00000100:00100000:2.0:1789135590.931075:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545011712:12345-0@lo:400: Request processed in 4159us (4537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135590.931090:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789135590.931139:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135590.931145:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135590.942721:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc1954ed00 x1876044545011712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135590.942738:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545011712:0@lo:400: 00010000:00080000:3.0:1789135590.942753:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc1954c780 x1876044545011584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135590.942761:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545011584:0@lo:400: 00010000:00080000:3.0:1789135590.942803:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc1954cb40 x1876044545011840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135590.942814:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545011840:0@lo:400: 00000100:00100000:3.0:1789135590.942823:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545011456:0@lo:400: 00000100:00100000:1.0:1789135590.947659:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545011968:0@lo:13: 00000100:00100000:1.0:1789135590.947727:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135590.948203:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545011968 00000100:00100000:2.0:1789135590.948210:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545011968 00000100:00100000:2.0:1789135590.948267:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135590.948278:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044545011968:12345-0@lo:13: 00002000:00000024:2.0:1789135590.948312:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135590.948356:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044545011968:12345-0@lo:13: Request processed in 80us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135590.948363:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789135590.952863:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc194ef0c0 x1876044545011968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135590.952890:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545011968:0@lo:13: 00000001:00080000:0.0:1789135591.059545:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789135591.124282:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135592.141759:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789135592.925496:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789135593.174695:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135594.188392:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135595.213973:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135596.047052:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545012480:0@lo:400: 00000100:00100000:1.0:1789135596.047124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135596.047172:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135596.047178:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545012352:0@lo:400: 00000100:00100000:1.0:1789135596.047217:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135596.047617:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545012096:0@lo:400: 00000100:00100000:3.0:1789135596.047647:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135596.047679:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545012608:0@lo:13: 00000100:00100000:3.0:1789135596.047700:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135596.047717:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135596.047721:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545012224:0@lo:400: 00000100:00100000:3.0:1789135596.047739:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135596.049002:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545012096 00000100:00100000:1.0:1789135596.049020:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545012096 00000100:00100000:1.0:1789135596.049076:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789135596.049086:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:3315:x1876044545012096:12345-0@lo:400: 00000100:00100000:1.0:1789135596.049142:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:3315:x1876044545012096:12345-0@lo:400: Request processed in 58us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135596.049149:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789135596.049224:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545012096:0@lo:400: 00000100:00100000:2.0:1789135596.050503:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545012480 00000100:00100000:2.0:1789135596.050511:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545012480 00000100:00100000:2.0:1789135596.050579:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135596.050588:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545012480:12345-0@lo:400: 00000100:00100000:2.0:1789135596.050653:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545012480:12345-0@lo:400: Request processed in 67us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135596.050660:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135596.050681:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545012352 00000100:00100000:2.0:1789135596.050685:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545012352 00000100:00100000:2.0:1789135596.050708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545012224 00000100:00100000:2.0:1789135596.050711:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545012224 00000100:00100000:2.0:1789135596.050725:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789135596.050731:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545012352:12345-0@lo:400: 00000100:00100000:2.0:1789135596.050775:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545012352:12345-0@lo:400: Request processed in 44us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135596.050782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789135596.050795:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135596.050801:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545012224:12345-0@lo:400: 00000100:00100000:2.0:1789135596.050835:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545012224:12345-0@lo:400: Request processed in 34us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135596.050841:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135596.050859:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545012608 00000100:00100000:2.0:1789135596.050862:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545012608 00000100:00100000:2.0:1789135596.050886:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789135596.050898:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19455a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545012608:12345-0@lo:13: 00002000:00000024:2.0:1789135596.050920:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135596.050950:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19455a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545012608:12345-0@lo:13: Request processed in 53us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135596.050957:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789135596.051015:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc156f7840 x1876044545012224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135596.051028:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545012224:0@lo:400: 00010000:00080000:2.0:1789135596.051040:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc194543c0 x1876044545012608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135596.051048:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789135596.051094:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545012608:0@lo:13: 00010000:00080000:2.0:1789135596.051128:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc156f6940 x1876044545012352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135596.051149:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545012352:0@lo:400: 00010000:00080000:2.0:1789135596.051162:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc156f4780 x1876044545012480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135596.051169:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545012480:0@lo:400: 00000100:00080000:3.0:1789135596.053041:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135596.053049:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789135596.236586:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135597.272150:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135598.286975:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135599.318360:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135600.333005:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135601.179329:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135601.179354:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545012736:0@lo:13: 00000100:00100000:3.0:1789135601.179428:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135601.179497:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545012736 00000100:00100000:3.0:1789135601.179504:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545012736 00000100:00100000:3.0:1789135601.179557:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135601.179566:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545012736:12345-0@lo:13: 00002000:00000024:3.0:1789135601.179600:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135601.179639:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545012736:12345-0@lo:13: Request processed in 75us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135601.179646:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789135601.179665:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135601.179691:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc194552c0 x1876044545012736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135601.179709:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545012736:0@lo:13: 00000100:00100000:0.0:1789135601.180765:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545012864:0@lo:400: 00000100:00100000:0.0:1789135601.180811:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135601.180843:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135601.180850:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545012992:0@lo:400: 00000100:00100000:0.0:1789135601.180874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135601.180903:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545012864 00000100:00100000:0.0:1789135601.180908:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545012864 00000100:00100000:0.0:1789135601.180938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135601.180945:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:3313:x1876044545012864:12345-0@lo:400: 00000100:00100000:0.0:1789135601.181004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:3313:x1876044545012864:12345-0@lo:400: Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135601.181011:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135601.181037:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545012992 00000100:00100000:0.0:1789135601.181041:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545012992 00000100:00100000:0.0:1789135601.181083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135601.181090:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545012992:12345-0@lo:400: 00000100:00100000:0.0:1789135601.181135:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545012992:12345-0@lo:400: Request processed in 45us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135601.181141:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135601.181172:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135601.181180:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545013120:0@lo:400: 00000100:00100000:0.0:1789135601.181203:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135601.181241:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545013120 00000100:00100000:0.0:1789135601.181244:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545013120 00000100:00100000:0.0:1789135601.181272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135601.181278:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545013120:12345-0@lo:400: 00000100:00100000:0.0:1789135601.181325:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545013120:12345-0@lo:400: Request processed in 48us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135601.181331:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789135601.181346:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135601.181366:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc194ecb40 x1876044545013120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135601.181387:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545013120:0@lo:400: 00010000:00080000:0.0:1789135601.181414:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc194ec780 x1876044545012992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135601.181422:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545012992:0@lo:400: 00000100:00100000:0.0:1789135601.181430:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545012864:0@lo:400: 00010000:00010000:2.0:1789135601.360774:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135602.382094:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135603.405432:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135604.437341:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135605.453123:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135606.284282:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545013248:0@lo:13: 00000100:00100000:1.0:1789135606.284347:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135606.284766:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135606.284775:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545013632:0@lo:400: 00000100:00100000:1.0:1789135606.284804:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135606.284918:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545013376:0@lo:400: 00000100:00100000:0.0:1789135606.284964:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135606.284998:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135606.285004:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545013504:0@lo:400: 00000100:00100000:0.0:1789135606.285048:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135606.285105:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545013632 00000100:00100000:0.0:1789135606.285120:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545013632 00000100:00100000:0.0:1789135606.285168:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545013504 00000100:00100000:0.0:1789135606.285171:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545013504 00000100:00100000:1.0:1789135606.285270:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545013376 00000100:00100000:1.0:1789135606.285274:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545013376 00000100:00100000:1.0:1789135606.285304:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789135606.285311:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:3313:x1876044545013376:12345-0@lo:400: 00000100:00100000:1.0:1789135606.285359:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:3313:x1876044545013376:12345-0@lo:400: Request processed in 48us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135606.285366:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135606.285443:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135606.285450:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545013632:12345-0@lo:400: 00000100:00100000:0.0:1789135606.285682:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545013632:12345-0@lo:400: Request processed in 232us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135606.285688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135606.285702:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135606.285708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545013504:12345-0@lo:400: 00000100:00100000:0.0:1789135606.285734:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545013504:12345-0@lo:400: Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135606.285740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789135606.285757:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135606.285792:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc3787d2c0 x1876044545013504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135606.285804:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545013504:0@lo:400: 00000100:00100000:0.0:1789135606.285814:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545013376:0@lo:400: 00000100:00100000:3.0:1789135606.285946:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545013248 00000100:00100000:3.0:1789135606.285950:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545013248 00000100:00100000:3.0:1789135606.285990:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135606.285997:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545013248:12345-0@lo:13: 00002000:00000024:3.0:1789135606.286023:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135606.286059:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545013248:12345-0@lo:13: Request processed in 62us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135606.286090:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789135606.286333:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc3787c780 x1876044545013632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135606.286344:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545013632:0@lo:400: 00010000:00080000:1.0:1789135606.286355:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc19454f00 x1876044545013248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135606.286367:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545013248:0@lo:13: 00000100:00080000:0.0:1789135606.286815:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789135606.480357:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135607.501881:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789135608.041738:0:7620:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789135608.041742:0:7620:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789135608.041872:0:7620:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adb01c80000 00000020:01000004:1.0:1789135608.041886:0:7620:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789135608.041898:0:7620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789135608.041911:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8adb01d01a48) 00000020:00000080:1.0:1789135608.041940:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789135608.066552:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789135608.066849:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789135608.146932:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789135608.156757:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789135608.156793:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789135608.156868:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789135608.156893:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789135608.157623:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789135608.157635:0:7620:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789135608.157644:0:7620:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b09da6ee1ce3dee 00000020:01000004:3.0:1789135608.157653:0:7620:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789135608.157742:0:7620:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789135608.157746:0:7620:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789135608.157752:0:7620:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789135608.157784:0:7620:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789135608.157788:0:7620:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789135608.184873:0:7620:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789135608.184905:0:7620:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.135@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789135608.184909:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789135608.184911:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135608.184926:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135608.184927:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135608.184928:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135608.184929:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135608.184931:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135608.184932:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135608.184933:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135608.184935:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135608.184936:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135608.184939:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789135608.184941:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789135608.184943:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135608.184944:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135608.184945:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135608.184946:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135608.184947:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135608.184948:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135608.184949:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135608.184950:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135608.184951:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135608.184952:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135608.184975:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789135608.184990:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545013760:0@lo:253: 00000100:00100000:0.0:1789135608.185423:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.185515:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135608.185564:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545013760 00000100:00100000:1.0:1789135608.185570:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545013760 00000100:00100000:1.0:1789135608.185676:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789135608.185688:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:7620:x1876044545013760:12345-0@lo:253: 20000000:01000000:1.0:1789135608.185717:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789135608.185721:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789135608.185725:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789135608.185728:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789135608.186798:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135608.187039:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789135608.187054:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789135608.187119:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789135608.187129:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789135608.187162:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789135608.187212:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789135608.188505:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789135608.188530:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.135@tcp 20000000:01000000:1.0:1789135608.188531:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:1.0:1789135608.188570:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789135608.188579:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789135608.188645:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789135608.188655:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:1.0:1789135608.188828:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789135608.188847:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789135608.188893:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789135608.188959:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789135608.192500:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789135608.192527:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.135@tcp 20000000:01000000:1.0:1789135608.192530:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.135@tcp (null) (null) (null) 00000040:00080000:1.0:1789135608.192563:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789135608.192570:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789135608.192599:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789135608.192606:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.135@tcp (null) (null) 00000040:00080000:1.0:1789135608.192635:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789135608.192643:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789135608.192771:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789135608.192815:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789135608.192834:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789135608.192837:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789135608.192840:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789135608.192852:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789135608.192855:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789135608.192890:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789135608.192893:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789135608.194009:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789135608.194235:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789135608.194275:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789135608.194748:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789135608.194787:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789135608.194835:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789135608.194846:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789135608.194848:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135608.195694:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135608.195753:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135608.195807:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789135608.196131:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789135608.196189:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789135608.196228:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789135608.196241:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789135608.196242:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789135608.200482:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789135608.200577:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789135608.200633:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789135608.203374:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789135608.203426:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789135608.203528:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789135608.203544:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789135608.203547:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789135608.206505:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789135608.206850:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789135608.206925:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789135608.207000:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789135608.207018:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789135608.207020:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789135608.207030:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789135608.207048:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207331:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc029e5a00/0x5b09da6ee1ce3d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207339:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207345:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207351:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207356:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207534:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207588:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207602:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 16 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135608.207615:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545013888:0@lo:104: 00000100:00100000:0.0:1789135608.207687:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135608.207734:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207742:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 16 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135608.207759:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1857d2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545014016:0@lo:104: 00010000:00010000:0.0:1789135608.207798:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207807:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 16 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135608.207816:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d792c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545014144:0@lo:104: 00010000:00010000:0.0:1789135608.207841:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207849:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 16 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135608.207857:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545014272:0@lo:104: 00010000:00010000:0.0:1789135608.207890:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc029e5a00/0x5b09da6ee1ce3d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.207899:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc029e5a00/0x5b09da6ee1ce3d38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 16 pid: 5832 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135608.207906:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545014400:0@lo:104: 00000100:00100000:0.0:1789135608.207933:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135608.208259:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789135608.208280:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.208302:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.208311:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.208319:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.208330:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545013888 00000100:00100000:1.0:1789135608.208335:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545013888 00000100:00100000:1.0:1789135608.208376:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545014016 00000100:00100000:1.0:1789135608.208380:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545014016 00000100:00100000:1.0:1789135608.208391:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545014144 00000100:00100000:1.0:1789135608.208393:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545014144 00000100:00100000:1.0:1789135608.208401:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545014272 00000100:00100000:1.0:1789135608.208403:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545014272 00000100:00100000:1.0:1789135608.208411:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545014400 00000100:00100000:1.0:1789135608.208413:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545014400 00000100:00100000:1.0:1789135608.208424:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135608.208433:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc299c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+7:5830:x1876044545013888:12345-0@lo:104: 00010000:00010000:1.0:1789135608.208446:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.208656:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135608.208675:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc299c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+7:5830:x1876044545013888:12345-0@lo:104: Request processed in 231us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.208682:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135608.208728:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135608.208735:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+6:5830:x1876044545014016:12345-0@lo:104: 00010000:00010000:1.0:1789135608.208743:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.208791:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789135608.208797:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+6:5830:x1876044545014016:12345-0@lo:104: Request processed in 63us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.208803:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135608.208818:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135608.208824:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+5:5830:x1876044545014144:12345-0@lo:104: 00010000:00010000:1.0:1789135608.208831:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.208864:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789135608.208869:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+5:5830:x1876044545014144:12345-0@lo:104: Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.208875:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135608.208901:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135608.208907:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:5830:x1876044545014272:12345-0@lo:104: 00010000:00010000:1.0:1789135608.208923:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.208952:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789135608.208957:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:5830:x1876044545014272:12345-0@lo:104: Request processed in 51us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.208963:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135608.208975:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789135608.208981:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:5830:x1876044545014400:12345-0@lo:104: 00010000:00010000:1.0:1789135608.208988:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce3d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209030:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789135608.209036:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:5830:x1876044545014400:12345-0@lo:104: Request processed in 56us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.209042:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789135608.209093:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789135608.209098:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209115:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135608.209119:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209127:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135608.209133:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135608.209139:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135608.209168:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209175:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135608.209191:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209198:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3de0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209220:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789135608.209223:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209228:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135608.209231:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209238:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135608.209244:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135608.209249:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135608.209262:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209268:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135608.209283:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209290:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3da8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209298:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789135608.209301:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209318:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb3600 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135608.209321:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209328:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135608.209335:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135608.209340:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135608.209354:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209359:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135608.209433:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209441:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3600/0x5b09da6ee1ce3d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209451:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135608.209453:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209459:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135608.209461:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209479:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135608.209491:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135608.209497:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135608.209511:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209516:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135608.209522:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209529:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce3d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d62 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209539:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135608.209542:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce3d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209547:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2200 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135608.209550:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce3d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209556:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce3d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135608.209561:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce3d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135608.209572:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135608.209585:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce3d31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209590:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135608.209594:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce3d31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209601:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce3d31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d38 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.209615:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135608.209617:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135608.209618:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135608.209640:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545014528:0@lo:103: 00000100:00100000:1.0:1789135608.209676:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.209704:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545015040:0@lo:103: 00000100:00100000:1.0:1789135608.209722:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.209740:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135608.209745:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545014912:0@lo:103: 00000100:00100000:1.0:1789135608.209765:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.209789:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545014656:0@lo:103: 00000100:00100000:1.0:1789135608.209811:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.209823:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135608.209827:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545014784:0@lo:103: 00000100:00100000:1.0:1789135608.209846:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.209869:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545014528 00000100:00100000:1.0:1789135608.209879:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545014528 00010000:00010000:1.0:1789135608.209911:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 17 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.209938:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545015040 00000100:00100000:1.0:1789135608.209941:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545015040 00010000:00010000:1.0:1789135608.209952:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc029e5a00/0x5b09da6ee1ce3d38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 18 pid: 5832 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.209961:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545014912 00000100:00100000:1.0:1789135608.209963:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545014912 00010000:00010000:1.0:1789135608.209971:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 19 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.209978:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545014656 00000100:00100000:1.0:1789135608.209980:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545014656 00010000:00010000:1.0:1789135608.209988:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 20 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.209997:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545014784 00000100:00100000:1.0:1789135608.209999:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545014784 00010000:00010000:1.0:1789135608.210008:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 21 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.210020:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135608.210026:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+21:3316:x1876044545014528:12345-0@lo:103: 00010000:00010000:1.0:1789135608.210036:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135608.210041:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 21 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.210050:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 21 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.210098:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135608.210131:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+21:3316:x1876044545014528:12345-0@lo:103: Request processed in 104us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.210138:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135608.210158:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135608.210164:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+20:3316:x1876044545015040:12345-0@lo:103: 00010000:00010000:1.0:1789135608.210171:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135608.210176:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc029e5a00/0x5b09da6ee1ce3d38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 20 pid: 5832 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.210183:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc029e5a00/0x5b09da6ee1ce3d38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 20 pid: 5832 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.210193:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135608.210213:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+20:3316:x1876044545015040:12345-0@lo:103: Request processed in 50us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.210219:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135608.210232:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135608.210238:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545014912:12345-0@lo:103: 00010000:00010000:1.0:1789135608.210245:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135608.210250:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 19 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.210257:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 19 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.210266:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135608.210295:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545014912:12345-0@lo:103: Request processed in 57us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.210301:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135608.210316:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135608.210322:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+18:3313:x1876044545014656:12345-0@lo:103: 00010000:00010000:1.0:1789135608.210329:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135608.210334:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 18 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.210342:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 18 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.210351:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135608.210483:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135608.210822:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+18:3313:x1876044545014656:12345-0@lo:103: Request processed in 499us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.210829:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135608.210847:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789135608.210854:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+17:3313:x1876044545014784:12345-0@lo:103: 00010000:00010000:1.0:1789135608.210862:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135608.210868:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 17 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135608.210997:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135608.211180:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 17 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211196:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211204:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211227:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211234:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211241:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211248:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211254:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031a00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135608.211258:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211265:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211275:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.211284:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135608.211314:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+17:3313:x1876044545014784:12345-0@lo:103: Request processed in 461us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.211321:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789135608.211587:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce3de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dd9 expref: 16 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.211597:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545013888:0@lo:104: 00010000:00010000:2.0:1789135608.211607:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3da1 expref: 15 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.211615:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1857d2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545014016:0@lo:104: 00010000:00010000:2.0:1789135608.211623:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d85 expref: 14 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.211630:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d792c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545014144:0@lo:104: 00010000:00010000:2.0:1789135608.211638:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e5600/0x5b09da6ee1ce3d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d5b expref: 13 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.211658:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545014272:0@lo:104: 00010000:00010000:2.0:1789135608.211682:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e5a00/0x5b09da6ee1ce3d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d31 expref: 12 pid: 5832 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.211691:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876044545014400:0@lo:104: 00010000:00010000:2.0:1789135608.211720:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.211730:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.211736:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.211742:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3df5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789135608.211756:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789135608.214207:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545014912:0@lo:103: 00000100:00100000:1.0:1789135608.214222:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545014528:0@lo:103: 00000100:00100000:1.0:1789135608.214229:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545015040:0@lo:103: 00000100:00100000:1.0:1789135608.214306:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545014784:0@lo:103: 00000100:00100000:1.0:1789135608.214315:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545014656:0@lo:103: 00000100:00100000:0.0:1789135608.278897:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+11:7620:x1876044545013760:12345-0@lo:253: Request processed in 93205us (93526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.278910:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789135608.279655:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545013760:0@lo:253: 10000000:01000000:2.0:1789135608.279670:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789135608.279673:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789135608.279674:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789135608.279676:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135608.279677:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789135608.279678:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135608.279680:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135608.279681:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135608.279683:0:7620:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789135608.279684:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135608.279685:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789135608.279710:0:7620:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adb01c80000 from lustre-OST0001 10000000:01000000:2.0:1789135608.279732:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789135608.279734:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789135608.279741:0:7620:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adc06b64ed8 local copy 10000000:01000000:2.0:1789135608.279744:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789135608.279772:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.279782:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.279791:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.279806:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015168:0@lo:101: 00000100:00100000:2.0:1789135608.279841:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.279941:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12178e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135608.279984:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545015168 00000100:00100000:0.0:1789135608.279989:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545015168 00000100:00100000:0.0:1789135608.280279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789135608.280288:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+11:7620:x1876044545015168:12345-0@lo:101: 00010000:00010000:0.0:1789135608.280300:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135608.280311:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3e03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3dfc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.280332:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dfc expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.280342:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dfc expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.280351:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030200, rc 0) 00000100:00100000:0.0:1789135608.280453:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015168:12345-0@lo:101: Request processed in 166us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.280459:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789135608.280527:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015168:0@lo:101: 00010000:00010000:1.0:1789135608.280539:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.280548:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.280634:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015296:0@lo:501: 00000100:00100000:1.0:1789135608.280658:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.280807:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137a9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135608.280884:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545015296 00000100:00100000:2.0:1789135608.280889:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545015296 00000100:00100000:2.0:1789135608.280907:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135608.280923:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015296:12345-0@lo:501: 00000100:00100000:2.0:1789135608.281236:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015296:12345-0@lo:501: Request processed in 322us (575us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789135608.281243:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789135608.281315:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015296:0@lo:501: 10000000:01000000:1.0:1789135608.281328:0:7620:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789135608.281351:0:7620:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789135608.281356:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.281376:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.281383:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.281402:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789135608.281421:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adb01c80000 10000000:01000000:1.0:1789135608.281431:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789135608.281436:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789135608.281438:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789135608.281442:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789135608.281445:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789135608.281469:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.281477:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.281485:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.281504:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015424:0@lo:101: 00000100:00100000:1.0:1789135608.281528:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.281544:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137a9540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135608.281678:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545015424 00000100:00100000:2.0:1789135608.281683:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545015424 00000100:00100000:2.0:1789135608.281700:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789135608.281705:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015424:12345-0@lo:101: 00010000:00010000:2.0:1789135608.281712:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135608.281721:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3e0a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.281741:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.281750:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.281757:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3e00, rc 0) 00000100:00100000:2.0:1789135608.281789:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545015424:12345-0@lo:101: Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.281795:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:2.0:1789135608.281815:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135608.281820:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.281827:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2a00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135608.281831:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.281839:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135608.281846:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135608.281852:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135608.281867:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.281874:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135608.281895:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.281902:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b09da6ee1ce3e03 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.281923:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135608.281925:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135608.281927:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135608.281934:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135608.281942:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545015552:0@lo:103: 00000100:00100000:2.0:1789135608.281967:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.281989:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545015552 00000100:00100000:2.0:1789135608.281992:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545015552 00000100:00100000:2.0:1789135608.282027:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135608.282033:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+13:3314:x1876044545015552:12345-0@lo:103: 00010000:00010000:2.0:1789135608.282040:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135608.282049:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3e03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dfc expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.282059:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135608.282212:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+12:3314:x1876044545015552:12345-0@lo:103: Request processed in 179us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.282219:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135608.282243:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545015552:0@lo:103: 00000100:00100000:1.0:1789135608.282314:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015424:0@lo:101: 00010000:00010000:1.0:1789135608.282325:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.282334:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.282452:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015680:0@lo:501: 00000100:00100000:1.0:1789135608.282481:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.282571:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137a9540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135608.282624:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545015680 00000100:00100000:2.0:1789135608.282628:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545015680 00000100:00100000:2.0:1789135608.282646:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789135608.282652:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015680:12345-0@lo:501: 00000100:00100000:2.0:1789135608.282834:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015680:12345-0@lo:501: Request processed in 181us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.282840:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135608.282987:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015680:0@lo:501: 00000100:00100000:1.0:1789135608.283437:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015808:0@lo:503: 00000100:00100000:1.0:1789135608.283485:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.283798:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135608.283865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545015808 00000100:00100000:3.0:1789135608.283870:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545015808 00000100:00100000:2.0:1789135608.283934:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789135608.283943:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015808:12345-0@lo:503: 00000100:00100000:2.0:1789135608.284349:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015808:12345-0@lo:503: Request processed in 406us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.284356:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789135608.284531:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015808:0@lo:503: 00000040:00080000:0.0:1789135608.284794:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789135608.284854:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d79680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015936:0@lo:502: 00000100:00100000:0.0:1789135608.284892:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.284939:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135608.285242:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545015936 00000100:00100000:1.0:1789135608.285247:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545015936 00000100:00100000:1.0:1789135608.285276:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789135608.285284:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015936:12345-0@lo:502: 00000100:00100000:1.0:1789135608.285460:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545015936:12345-0@lo:502: Request processed in 176us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.285467:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789135608.285749:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d79680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545015936:0@lo:502: 00000040:00080000:0.0:1789135608.286624:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789135608.286688:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789135608.286725:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789135608.286792:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789135608.286833:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789135608.286870:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789135608.286906:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d79680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016064:0@lo:502: 00000100:00100000:0.0:1789135608.286975:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.287591:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135608.287962:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545016064 00000100:00100000:3.0:1789135608.287970:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545016064 00000100:00100000:3.0:1789135608.288300:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789135608.288311:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545016064:12345-0@lo:502: 00000100:00100000:3.0:1789135608.288624:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545016064:12345-0@lo:502: Request processed in 315us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135608.288631:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789135608.288734:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d79680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016064:0@lo:502: 00000040:00080000:1.0:1789135608.288844:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789135608.288856:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789135608.289690:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789135608.289699:0:7627:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789135608.289704:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135608.289707:0:7627:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789135608.289712:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789135608.289725:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8adc0478ced8) 00000020:00000080:0.0:1789135608.289744:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789135608.289750:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789135608.289817:0:7627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adb01c80000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789135608.289824:0:7627:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789135608.289831:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b09da6ee1ce3e1f 00010000:00010000:0.0:1789135608.295835:0:7627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789135608.296477:0:7627:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789135608.299438:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789135608.299834:0:7627:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789135608.305820:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789135608.306810:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789135608.309768:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789135608.309779:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135608.309785:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135608.309787:0:7627:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789135608.309790:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135608.309794:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135608.309796:0:7627:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789135608.309799:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789135608.309800:0:7627:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789135608.309837:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135608.309841:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135608.309842:0:7627:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789135608.309845:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789135608.314470:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789135608.314521:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789135608.314542:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.314555:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135608.314688:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adb01c80000 from 1 10000000:01000000:2.0:1789135608.314692:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135608.314725:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.314734:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.314744:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.314765:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016192:0@lo:101: 00000100:00100000:2.0:1789135608.314828:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.314870:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc121786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135608.314971:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545016192 00000100:00100000:0.0:1789135608.314978:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545016192 00000100:00100000:0.0:1789135608.315477:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789135608.315487:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:7620:x1876044545016192:12345-0@lo:101: 00010000:00010000:0.0:1789135608.315608:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135608.315623:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3e26 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.315645:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.315656:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.315664:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031800, rc 0) 00000100:00100000:0.0:1789135608.315715:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016192:12345-0@lo:101: Request processed in 229us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.315722:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789135608.315819:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016192:0@lo:101: 00010000:00010000:2.0:1789135608.315840:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.315848:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.315969:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016320:0@lo:501: 00000100:00100000:2.0:1789135608.316013:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.316042:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc121786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135608.316296:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545016320 00000100:00100000:1.0:1789135608.316301:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545016320 00000100:00100000:1.0:1789135608.316333:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789135608.316340:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016320:12345-0@lo:501: 00000100:00100000:1.0:1789135608.316574:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016320:12345-0@lo:501: Request processed in 235us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.316581:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789135608.316905:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016320:0@lo:501: 00000100:00100000:0.0:1789135608.316954:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016448:0@lo:503: 00000100:00100000:0.0:1789135608.317013:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.317042:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135608.317309:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545016448 00000100:00100000:2.0:1789135608.317315:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545016448 00000100:00100000:2.0:1789135608.317350:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789135608.317358:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016448:12345-0@lo:503: 00000100:00100000:2.0:1789135608.317673:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016448:12345-0@lo:503: Request processed in 315us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.317680:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789135608.317993:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016448:0@lo:503: 00000040:00080000:0.0:1789135608.318685:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789135608.318745:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016576:0@lo:502: 00000100:00100000:0.0:1789135608.318794:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.318823:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135608.318841:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545016576 00000100:00100000:0.0:1789135608.318846:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545016576 00000100:00100000:0.0:1789135608.319260:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789135608.319271:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016576:12345-0@lo:502: 00000100:00100000:0.0:1789135608.319822:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016576:12345-0@lo:502: Request processed in 552us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.319829:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789135608.324580:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016576:0@lo:502: 00000040:00080000:0.0:1789135608.324883:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789135608.325933:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789135608.325976:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016704:0@lo:502: 00000100:00100000:0.0:1789135608.326086:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.326135:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135608.326684:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545016704 00000100:00100000:2.0:1789135608.326693:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545016704 00000100:00100000:2.0:1789135608.326744:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789135608.326753:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016704:12345-0@lo:502: 00000100:00100000:2.0:1789135608.326957:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016704:12345-0@lo:502: Request processed in 205us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.326965:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789135608.327033:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016704:0@lo:502: 00000040:00080000:2.0:1789135608.327419:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789135608.327431:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789135608.328879:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135608.328901:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135608.328903:0:7631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789135608.328909:0:7631:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adb01c80000 00000020:00000080:0.0:1789135608.328921:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789135608.328941:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135608.328944:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135608.328945:0:7631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789135608.328948:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789135608.329239:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789135608.329262:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135608.329286:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.329296:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135608.329343:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789135608.329346:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adb01c80000 10000000:01000000:2.0:1789135608.329349:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adb01c80000 10000000:01000000:2.0:1789135608.329352:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135608.329357:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adb01c80000 from 1 10000000:01000000:2.0:1789135608.329369:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135608.329411:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.329419:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.329429:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.329448:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016832:0@lo:101: 00000100:00100000:2.0:1789135608.329612:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.329644:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135608.329664:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545016832 00000100:00100000:2.0:1789135608.329670:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545016832 00000100:00100000:2.0:1789135608.329707:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789135608.329715:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545016832:12345-0@lo:101: 00010000:00010000:2.0:1789135608.329727:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135608.329738:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3e34 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.329760:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.329782:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.329790:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3a00, rc 0) 00000100:00100000:2.0:1789135608.329824:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545016832:12345-0@lo:101: Request processed in 110us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.329830:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789135608.329876:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016832:0@lo:101: 00010000:00010000:2.0:1789135608.329888:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.329896:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.329983:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016960:0@lo:501: 00000100:00100000:2.0:1789135608.330645:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.330666:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135608.330683:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545016960 00000100:00100000:2.0:1789135608.330688:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545016960 00000100:00100000:2.0:1789135608.330712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789135608.330718:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545016960:12345-0@lo:501: 00000100:00100000:2.0:1789135608.330908:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545016960:12345-0@lo:501: Request processed in 189us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.330927:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789135608.330963:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545016960:0@lo:501: 00000100:00100000:2.0:1789135608.330992:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545017088:0@lo:503: 00000100:00100000:2.0:1789135608.331586:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.331618:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135608.331662:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545017088 00000100:00100000:3.0:1789135608.331667:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545017088 00000100:00100000:3.0:1789135608.331700:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789135608.331707:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545017088:12345-0@lo:503: 00000100:00100000:3.0:1789135608.331936:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545017088:12345-0@lo:503: Request processed in 228us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135608.331943:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789135608.336745:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545017088:0@lo:503: 00000040:00080000:0.0:1789135608.337253:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789135608.337325:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545017216:0@lo:502: 00000100:00100000:0.0:1789135608.337411:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.337445:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135608.337714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545017216 00000100:00100000:2.0:1789135608.337721:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545017216 00000100:00100000:2.0:1789135608.337770:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789135608.337778:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545017216:12345-0@lo:502: 00000100:00100000:2.0:1789135608.338020:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545017216:12345-0@lo:502: Request processed in 242us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135608.338028:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789135608.338297:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545017216:0@lo:502: 00000040:00080000:0.0:1789135608.338685:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789135608.338736:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789135608.338766:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789135608.338820:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789135608.338859:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789135608.338907:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789135608.338957:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789135608.338991:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789135608.339054:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789135608.339472:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789135608.339584:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789135608.339640:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789135608.339679:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789135608.339713:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789135608.339771:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789135608.339809:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789135608.339838:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789135608.339878:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789135608.339910:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789135608.339958:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789135608.340000:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789135608.342806:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789135608.342846:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789135608.342932:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789135608.342971:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789135608.343745:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789135608.343818:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789135608.343849:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789135608.343877:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789135608.343928:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789135608.343963:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789135608.343990:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789135608.344678:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789135608.344765:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789135608.344805:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789135608.344858:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789135608.344896:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789135608.344952:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545017344:0@lo:502: 00000100:00100000:2.0:1789135608.345612:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.345723:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05300 going to sleep for 11 seconds 00000100:00100000:3.0:1789135608.345800:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545017344 00000100:00100000:3.0:1789135608.345807:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545017344 00000100:00100000:3.0:1789135608.345925:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789135608.345935:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545017344:12345-0@lo:502: 00000100:00100000:3.0:1789135608.346701:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545017344:12345-0@lo:502: Request processed in 766us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135608.346711:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789135608.346969:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545017344:0@lo:502: 00000040:00080000:0.0:1789135608.347311:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789135608.347324:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789135608.348612:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789135608.348626:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8adc0478b490) 00000020:00000080:0.0:1789135608.348651:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789135608.348709:0:7632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adb01c80000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789135608.348713:0:7632:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adb01c80000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789135608.348715:0:7632:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adb01c80000 3 00010000:00080000:0.0:1789135608.348739:0:7632:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adc41911800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1789135608.351939:0:7632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789135608.352530:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789135608.352572:0:7632:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789135608.352583:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5b09da6ee1ce3e49 00000100:00080000:3.0:1789135608.352594:0:7632:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789135608.352599:0:7632:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc41911800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135608.352633:0:7632:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc19454b40 x1876044545017472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789135608.352662:0:7632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789135608.352899:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545017472:0@lo:38: 00000100:00100000:0.0:1789135608.352977:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.353432:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545017728:0@lo:400: 00000100:00100000:1.0:1789135608.353465:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135608.353487:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135608.353505:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545017856:0@lo:400: 00000100:00100000:1.0:1789135608.353530:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.353676:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545017600:0@lo:400: 00000100:00100000:0.0:1789135608.353707:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.353748:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545017472 00000100:00100000:0.0:1789135608.353754:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545017472 00000100:00100000:0.0:1789135608.353774:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545017728 00000100:00100000:0.0:1789135608.353777:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545017728 00000100:00100000:0.0:1789135608.353804:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545017600 00000100:00100000:0.0:1789135608.353806:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545017600 00000100:00100000:0.0:1789135608.353818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135608.353824:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545017728:12345-0@lo:400: 00000100:00100000:0.0:1789135608.353871:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545017728:12345-0@lo:400: Request processed in 47us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.353878:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135608.353892:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135608.353897:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545017600:12345-0@lo:400: 00000100:00100000:0.0:1789135608.353939:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545017600:12345-0@lo:400: Request processed in 41us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.353946:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135608.353957:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135608.353961:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876044545017472:12345-0@lo:38: 00010000:00080000:0.0:1789135608.353979:0:5838:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1789135608.354049:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5b09da6ee1ce3e50 00000004:00100000:0.0:1789135608.354091:0:5838:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789135608.354240:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8adc41915800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135608.354281:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044545017472:12345-0@lo:38: Request processed in 317us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.354288:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135608.354309:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545017856 00000100:00100000:0.0:1789135608.354313:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545017856 00000100:00100000:0.0:1789135608.354346:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135608.354353:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545017856:12345-0@lo:400: 00000100:00100000:0.0:1789135608.354398:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545017856:12345-0@lo:400: Request processed in 46us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.354405:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789135608.354422:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135608.354425:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135608.354453:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc19454b40 x1876044545017472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135608.354464:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135608.354471:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789135608.354478:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789135608.354482:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789135608.354484:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc41911800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789135608.354490:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545017472:0@lo:38: 00010000:00080000:0.0:1789135608.354633:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc3787c3c0 x1876044545017600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135608.354643:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545017600:0@lo:400: 00010000:00080000:0.0:1789135608.354671:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc3787e1c0 x1876044545017856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135608.354680:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545017856:0@lo:400: 00010000:00080000:0.0:1789135608.354688:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc3787f480 x1876044545017728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135608.354695:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545017728:0@lo:400: 00000040:00080000:3.0:1789135608.354996:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1789135608.355452:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7bc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1876044545017984:0@lo:901: 00000100:00100000:0.0:1789135608.355614:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135608.355645:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135608.355694:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545017984 00000100:00100000:3.0:1789135608.355700:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545017984 00000100:00100000:3.0:1789135608.355756:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135608.355764:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1876044545017984:12345-0@lo:901: 00000100:00100000:3.0:1789135608.356711:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1876044545017984:12345-0@lo:901: Request processed in 946us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135608.356720:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789135608.356798:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1789135608.357300:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789135608.357331:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135608.357356:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135608.357373:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789135608.357433:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789135608.357440:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789135608.357441:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135608.357442:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135608.357443:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135608.357444:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135608.357445:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135608.357447:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135608.357448:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135608.357450:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135608.357451:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135608.357454:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789135608.357456:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135608.357457:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789135608.357458:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135608.357459:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135608.357460:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135608.357461:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135608.357462:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135608.357463:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135608.357464:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135608.357465:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135608.357465:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135608.357490:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789135608.357514:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545018112:0@lo:253: 00000100:00100000:3.0:1789135608.357557:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135608.357590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545018112 00000100:00100000:3.0:1789135608.357595:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545018112 00000100:00100000:3.0:1789135608.357631:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789135608.357639:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:7620:x1876044545018112:12345-0@lo:253: 20000000:01000000:3.0:1789135608.357668:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789135608.357681:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789135608.358094:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d209c0 going to sleep for 11 seconds 00010000:00080000:1.0:1789135608.362775:0:7633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc41d7bc00 x1876044545017984/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789135624 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135608.362822:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7bc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1876044545017984:0@lo:901: 20000000:01000000:0.0:1789135608.428940:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789135608.429025:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789135608.434288:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789135608.434297:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789135608.434318:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.434344:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.434378:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.434435:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135608.434451:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 14 pid: 5831 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135608.434481:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1876044545018240:0@lo:104: 00000100:00100000:2.0:1789135608.434581:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.434658:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135608.434876:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545018240 00000100:00100000:0.0:1789135608.434884:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545018240 00000100:00100000:0.0:1789135608.434950:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135608.434960:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+3:5852:x1876044545018240:12345-0@lo:104: 00010000:00010000:0.0:1789135608.434973:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.435041:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135608.435048:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+3:5852:x1876044545018240:12345-0@lo:104: Request processed in 90us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.435055:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789135608.435098:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135608.435119:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.435148:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc029e5000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:0.0:1789135608.435152:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.435160:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135608.435168:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135608.435174:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135608.435202:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.435209:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135608.435226:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.435233:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc029e5000/0x5b09da6ee1ce3d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135608.435252:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135608.435254:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135608.435255:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135608.435270:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135608.435280:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545018368:0@lo:103: 00000100:00100000:0.0:1789135608.435312:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135608.435960:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1876044545018240:0@lo:104: 00010000:00010000:2.0:1789135608.435980:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.436792:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545018368 00000100:00100000:1.0:1789135608.436800:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545018368 00010000:00010000:1.0:1789135608.436838:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 15 pid: 5831 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135608.436860:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135608.436867:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05775850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+15:3314:x1876044545018368:12345-0@lo:103: 00010000:00010000:1.0:1789135608.436878:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135608.436882:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 15 pid: 5831 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.436893:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 15 pid: 5831 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.436907:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce3d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d93 expref: 15 pid: 5831 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.436934:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.436942:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789135608.436955:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002690794s 00010000:00010000:1.0:1789135608.436959:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.436966:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.436983:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.436989:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.436994:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135608.436998:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.437016:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.437034:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135608.437043:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135608.437294:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05775850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+14:3314:x1876044545018368:12345-0@lo:103: Request processed in 426us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135608.437303:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135608.437386:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545018368:0@lo:103: 00010000:00010000:3.0:1789135608.437653:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135608.437661:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135608.437674:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3e57 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135608.452566:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+13:7620:x1876044545018112:12345-0@lo:253: Request processed in 94920us (95000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135608.452596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789135608.452708:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:45dd8677-45c4-4169-a65f-287162436408:7620:1876044545018112:0@lo:253: 10000000:01000000:2.0:1789135608.452723:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789135608.452727:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789135608.452728:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789135608.452730:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135608.452731:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135608.452732:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135608.452734:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135608.452735:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135608.452737:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135608.452738:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135608.452740:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135608.452741:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789135608.452756:0:7620:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789135608.459803:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135608.460017:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135608.460857:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135608.461430:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135608.461857:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135608.463811:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789135608.465876:0:7620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789135608.527908:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789135608.860276:0:7620:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789135608.860283:0:7620:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789135608.860317:0:7620:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789135608.860661:0:7620:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789135608.860676:0:7620:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789135608.860701:0:7620:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789135609.558670:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135610.572447:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135611.405564:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135611.405596:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545018496:0@lo:13: 00000100:00100000:1.0:1789135611.405658:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135611.405935:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545018496 00000100:00100000:1.0:1789135611.405943:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545018496 00000100:00100000:1.0:1789135611.406003:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135611.406011:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545018496:12345-0@lo:13: 00002000:00000024:1.0:1789135611.406056:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135611.406114:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545018496:12345-0@lo:13: Request processed in 104us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135611.406121:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789135611.406164:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3787e940 x1876044545018496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135611.406179:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545018496:0@lo:13: 00000100:00080000:2.0:1789135611.406241:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789135611.597642:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135612.621167:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135613.463351:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545018752:0@lo:400: 00000100:00100000:3.0:1789135613.463903:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135613.463991:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789135613.463999:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545018624:0@lo:400: 00000100:00100000:3.0:1789135613.464036:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135613.464096:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545019136:0@lo:400: 00000100:00100000:3.0:1789135613.464127:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135613.464157:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545018880:0@lo:400: 00000100:00100000:3.0:1789135613.464180:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135613.464199:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135613.464204:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19457840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545019008:0@lo:400: 00000100:00100000:3.0:1789135613.464228:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135613.464263:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545018752 00000100:00100000:3.0:1789135613.464271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545018752 00000100:00100000:3.0:1789135613.464312:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545019136 00000100:00100000:3.0:1789135613.464315:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545019136 00000100:00100000:3.0:1789135613.464353:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545018880 00000100:00100000:3.0:1789135613.464371:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545018880 00000100:00100000:3.0:1789135613.464392:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135613.464410:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545018752:12345-0@lo:400: 00000100:00100000:3.0:1789135613.468140:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545018752:12345-0@lo:400: Request processed in 3720us (4665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135613.468157:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135613.468205:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789135613.468219:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19455680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545019136:12345-0@lo:400: 00000100:00100000:3.0:1789135613.468269:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19455680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545019136:12345-0@lo:400: Request processed in 56us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135613.468275:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789135613.468287:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789135613.468294:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545018880:12345-0@lo:400: 00000100:00100000:3.0:1789135613.468343:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545018880:12345-0@lo:400: Request processed in 50us (4162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135613.468350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789135613.468376:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545018624 00000100:00100000:3.0:1789135613.468385:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545018624 00000100:00100000:3.0:1789135613.468437:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789135613.468452:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:3316:x1876044545018624:12345-0@lo:400: 00010000:00080000:0.0:1789135613.469673:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc19454b40 x1876044545018880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135613.469694:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545018880:0@lo:400: 00000100:00100000:3.0:1789135613.472121:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:3316:x1876044545018624:12345-0@lo:400: Request processed in 3658us (8072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135613.472137:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789135613.472233:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545019008 00000100:00100000:3.0:1789135613.472242:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545019008 00000100:00100000:3.0:1789135613.472304:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135613.472315:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545019008:12345-0@lo:400: 00000100:00100000:3.0:1789135613.472422:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545019008:12345-0@lo:400: Request processed in 109us (8192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135613.472430:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789135613.472459:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135613.472465:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789135613.473255:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc19457840 x1876044545019008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135613.473273:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19457840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545019008:0@lo:400: 00010000:00080000:1.0:1789135613.476226:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc194552c0 x1876044545018752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135613.476250:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545018752:0@lo:400: 00000100:00100000:1.0:1789135613.476283:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545018624:0@lo:400: 00010000:00080000:1.0:1789135613.476299:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc19454780 x1876044545019136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135613.476308:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545019136:0@lo:400: 00010000:00010000:0.0:1789135613.644962:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135614.673414:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789135614.988157:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789135614.988164:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc057f3800 from 30 10000000:01000000:0.0:1789135614.988168:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789135614.988203:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135614.988215:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135614.988225:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135614.988246:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545019264:0@lo:101: 00000100:00100000:0.0:1789135614.988303:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135614.988349:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13eac300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135614.988409:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545019264 00000100:00100000:1.0:1789135614.988416:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545019264 00000100:00100000:1.0:1789135614.988459:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135614.988466:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545019264:12345-0@lo:101: 00010000:00010000:1.0:1789135614.988478:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135614.988489:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3e5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135614.988510:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135614.988531:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135614.988541:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481a00, rc 0) 00000100:00100000:1.0:1789135614.988583:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545019264:12345-0@lo:101: Request processed in 117us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135614.988590:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789135614.988761:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545019264:0@lo:101: 00010000:00010000:0.0:1789135614.988774:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135614.988782:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135614.988839:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545019392:0@lo:501: 00000100:00100000:0.0:1789135614.988862:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135614.988901:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13eac300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135614.988974:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545019392 00000100:00100000:2.0:1789135614.988978:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545019392 00000100:00100000:2.0:1789135614.989008:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789135614.989016:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545019392:12345-0@lo:501: 00000100:00100000:2.0:1789135614.989357:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545019392:12345-0@lo:501: Request processed in 341us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135614.989363:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789135614.989407:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545019392:0@lo:501: 00000100:00100000:2.0:1789135614.989435:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545019520:0@lo:503: 00000100:00100000:2.0:1789135614.989472:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135614.989485:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135614.989495:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545019520 00000100:00100000:2.0:1789135614.989499:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545019520 00000100:00100000:2.0:1789135614.989514:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789135614.989519:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545019520:12345-0@lo:503: 00000100:00100000:2.0:1789135614.990291:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545019520:12345-0@lo:503: Request processed in 769us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135614.990307:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789135614.994712:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545019520:0@lo:503: 00000100:00100000:0.0:1789135614.996906:0:7842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7842:1876044545019648:0@lo:502: 00000100:00100000:0.0:1789135614.996994:0:7842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135614.997052:0:7842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13eac300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135614.997182:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545019648 00000100:00100000:1.0:1789135614.997189:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545019648 00000100:00100000:1.0:1789135614.997227:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789135614.997235:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:7842:x1876044545019648:12345-0@lo:502: 00000100:00100000:1.0:1789135614.997514:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:7842:x1876044545019648:12345-0@lo:502: Request processed in 280us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135614.997522:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789135614.997693:0:7842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7842:1876044545019648:0@lo:502: 00000100:00100000:0.0:1789135614.997740:0:7842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7842:1876044545019776:0@lo:502: 00000100:00100000:0.0:1789135614.997988:0:7842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135614.998055:0:7842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11937d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135615.003412:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545019776 00000100:00100000:3.0:1789135615.003436:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545019776 00000100:00100000:3.0:1789135615.003488:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789135615.003497:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:7842:x1876044545019776:12345-0@lo:502: 00000100:00100000:3.0:1789135615.003776:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:7842:x1876044545019776:12345-0@lo:502: Request processed in 280us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135615.003784:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789135615.003840:0:7842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7842:1876044545019776:0@lo:502: 00000040:00080000:3.0:1789135615.003873:0:7842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789135615.004199:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789135615.004221:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789135615.004229:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.004240:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135615.004249:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789135615.004251:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789135615.004254:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789135615.004283:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.004290:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.004298:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135615.004315:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545019904:0@lo:101: 00000100:00100000:2.0:1789135615.004351:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135615.004375:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.004440:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545019904 00000100:00100000:1.0:1789135615.004445:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545019904 00000100:00100000:1.0:1789135615.004475:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789135615.004483:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545019904:12345-0@lo:101: 00010000:00010000:1.0:1789135615.004492:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135615.004503:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3e6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.004523:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.004534:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.004555:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481200, rc 0) 00000100:00100000:1.0:1789135615.004595:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545019904:12345-0@lo:101: Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.004601:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789135615.004803:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545019904:0@lo:101: 00010000:00010000:2.0:1789135615.004816:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.004825:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135615.004888:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020032:0@lo:501: 00000100:00100000:2.0:1789135615.004914:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135615.004932:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.004972:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545020032 00000100:00100000:1.0:1789135615.004976:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545020032 00000100:00100000:1.0:1789135615.005006:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789135615.005012:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545020032:12345-0@lo:501: 00000100:00100000:1.0:1789135615.005509:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545020032:12345-0@lo:501: Request processed in 495us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.005516:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789135615.010513:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020032:0@lo:501: 00000100:00100000:2.0:1789135615.010573:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020160:0@lo:503: 00000100:00100000:2.0:1789135615.010640:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135615.010739:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.018898:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545020160 00000100:00100000:1.0:1789135615.018909:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545020160 00000100:00100000:1.0:1789135615.018965:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789135615.018975:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545020160:12345-0@lo:503: 00000100:00100000:1.0:1789135615.019366:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545020160:12345-0@lo:503: Request processed in 391us (8724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.019374:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789135615.019454:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020160:0@lo:503: 00000100:00100000:1.0:1789135615.019671:0:7845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7845:1876044545020288:0@lo:502: 00000100:00100000:1.0:1789135615.019725:0:7845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.019752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545020288 00000100:00100000:1.0:1789135615.019756:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545020288 00000100:00100000:1.0:1789135615.019778:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135615.019784:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:7845:x1876044545020288:12345-0@lo:502: 00000100:00100000:1.0:1789135615.019975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:7845:x1876044545020288:12345-0@lo:502: Request processed in 190us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.019982:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135615.020024:0:7845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d209c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.020037:0:7845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7845:1876044545020288:0@lo:502: 00000020:01000000:1.0:1789135615.020057:0:7845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135615.020078:0:7845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135615.020081:0:7845:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135615.020086:0:7845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135615.020088:0:7845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789135615.020102:0:7845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7845:1876044545020416:0@lo:502: 00000100:00100000:1.0:1789135615.020133:0:7845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.020153:0:7845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d209c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135615.020172:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545020416 00000100:00100000:2.0:1789135615.020178:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545020416 00000100:00100000:2.0:1789135615.020210:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789135615.020217:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:7845:x1876044545020416:12345-0@lo:502: 00000100:00100000:2.0:1789135615.020576:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:7845:x1876044545020416:12345-0@lo:502: Request processed in 304us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135615.020584:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789135615.020964:0:7845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7845:1876044545020416:0@lo:502: 00000020:01000000:0.0:1789135615.020986:0:7845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135615.020990:0:7845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135615.020992:0:7845:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789135615.021000:0:7845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789135615.021426:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789135615.021446:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789135615.021456:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.021465:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135615.021473:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789135615.021475:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc10b30000 from 30 10000000:01000000:1.0:1789135615.021478:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135615.021502:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.021509:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.021529:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135615.021545:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020544:0@lo:101: 00000100:00100000:1.0:1789135615.021582:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.021606:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d20000 going to sleep for 11 seconds 00000100:00100000:0.0:1789135615.022082:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545020544 00000100:00100000:0.0:1789135615.022088:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545020544 00000100:00100000:1.0:1789135615.022154:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789135615.022163:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545020544:12345-0@lo:101: 00010000:00010000:1.0:1789135615.022174:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135615.022185:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3e7a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.022205:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.022215:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.022357:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480a00, rc 0) 00000100:00100000:1.0:1789135615.022406:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545020544:12345-0@lo:101: Request processed in 244us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.022412:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789135615.022466:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020544:0@lo:101: 00010000:00010000:0.0:1789135615.022479:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135615.022487:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135615.022556:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020672:0@lo:501: 00000100:00100000:0.0:1789135615.022597:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135615.022626:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11937d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.022795:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545020672 00000100:00100000:1.0:1789135615.022800:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545020672 00000100:00100000:1.0:1789135615.022986:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789135615.022995:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545020672:12345-0@lo:501: 00000100:00100000:1.0:1789135615.023254:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545020672:12345-0@lo:501: Request processed in 259us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.023266:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789135615.055912:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020672:0@lo:501: 00000100:00100000:1.0:1789135615.055970:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020800:0@lo:503: 00000100:00100000:1.0:1789135615.056043:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.056103:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d20540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.056121:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545020800 00000100:00100000:1.0:1789135615.056126:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545020800 00000100:00100000:1.0:1789135615.056166:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789135615.056175:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545020800:12345-0@lo:503: 00000100:00100000:1.0:1789135615.056346:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545020800:12345-0@lo:503: Request processed in 171us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.056353:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789135615.056406:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545020800:0@lo:503: 00000100:00100000:1.0:1789135615.057479:0:7847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7847:1876044545020928:0@lo:502: 00000100:00100000:1.0:1789135615.057533:0:7847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.057564:0:7847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.057581:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545020928 00000100:00100000:1.0:1789135615.057586:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545020928 00000100:00100000:1.0:1789135615.057618:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789135615.057626:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:7847:x1876044545020928:12345-0@lo:502: 00000100:00100000:1.0:1789135615.057828:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:7847:x1876044545020928:12345-0@lo:502: Request processed in 203us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.057835:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789135615.057904:0:7847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7847:1876044545020928:0@lo:502: 00000100:00100000:1.0:1789135615.057954:0:7847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7847:1876044545021056:0@lo:502: 00000100:00100000:1.0:1789135615.057987:0:7847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.058004:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545021056 00000100:00100000:1.0:1789135615.058008:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545021056 00000100:00100000:1.0:1789135615.058027:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789135615.058046:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:7847:x1876044545021056:12345-0@lo:502: 00000100:00100000:1.0:1789135615.058181:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:7847:x1876044545021056:12345-0@lo:502: Request processed in 147us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.058188:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789135615.058222:0:7847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.058234:0:7847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7847:1876044545021056:0@lo:502: 00000040:00080000:1.0:1789135615.058252:0:7847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789135615.058300:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789135615.058322:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789135615.058332:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058342:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135615.058363:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789135615.058365:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc10b30000 from 5 10000000:01000000:1.0:1789135615.058368:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789135615.058392:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058400:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058419:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135615.058432:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021184:0@lo:101: 00000100:00100000:1.0:1789135615.058459:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.058471:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.058481:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545021184 00000100:00100000:1.0:1789135615.058483:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545021184 00000100:00100000:1.0:1789135615.058502:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789135615.058508:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545021184:12345-0@lo:101: 00010000:00010000:1.0:1789135615.058514:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135615.058525:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01480000/0x5b09da6ee1ce3e8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3e88 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058542:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01480000/0x5b09da6ee1ce3e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e88 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058551:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01480000/0x5b09da6ee1ce3e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e88 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058560:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480000, rc 0) 00000100:00100000:1.0:1789135615.058586:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545021184:12345-0@lo:101: Request processed in 77us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.058592:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789135615.058620:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021184:0@lo:101: 00010000:00010000:1.0:1789135615.058631:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058649:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135615.058684:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021312:0@lo:256: 00000100:00100000:1.0:1789135615.058713:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.058725:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.058737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545021312 00000100:00100000:1.0:1789135615.058740:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545021312 00000100:00100000:1.0:1789135615.058759:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789135615.058764:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545021312:12345-0@lo:256: 20000000:01000000:1.0:1789135615.058775:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789135615.058791:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789135615.058793:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789135615.058859:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545021312:12345-0@lo:256: Request processed in 94us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.058865:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789135615.058909:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021312:0@lo:256: 10000000:01000000:1.0:1789135615.058945:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789135615.058950:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058958:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135615.058963:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789135615.058965:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789135615.058967:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789135615.058987:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.058993:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.059000:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135615.059009:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021440:0@lo:101: 00000100:00100000:1.0:1789135615.059033:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.059045:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.059055:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545021440 00000100:00100000:1.0:1789135615.059058:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545021440 00000100:00100000:1.0:1789135615.059097:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789135615.059103:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545021440:12345-0@lo:101: 00010000:00010000:1.0:1789135615.059109:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135615.059117:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3e96 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.059130:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.059137:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.059143:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481c00, rc 0) 00000100:00100000:1.0:1789135615.059171:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545021440:12345-0@lo:101: Request processed in 68us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.059176:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789135615.059212:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021440:0@lo:101: 00010000:00010000:1.0:1789135615.059222:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.059229:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135615.059260:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021568:0@lo:501: 00000100:00100000:1.0:1789135615.059282:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.059293:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.059302:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545021568 00000100:00100000:1.0:1789135615.059305:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545021568 00000100:00100000:1.0:1789135615.059320:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789135615.059326:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545021568:12345-0@lo:501: 00000100:00100000:1.0:1789135615.059516:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545021568:12345-0@lo:501: Request processed in 189us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.059522:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789135615.059552:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021568:0@lo:501: 00000100:00100000:1.0:1789135615.059576:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021696:0@lo:503: 00000100:00100000:1.0:1789135615.059611:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.059623:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.059634:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545021696 00000100:00100000:1.0:1789135615.059637:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545021696 00000100:00100000:1.0:1789135615.059656:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789135615.059662:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545021696:12345-0@lo:503: 00000100:00100000:1.0:1789135615.059927:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545021696:12345-0@lo:503: Request processed in 264us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.059942:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789135615.059982:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545021696:0@lo:503: 00000100:00100000:1.0:1789135615.065537:0:7848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7848:1876044545021824:0@lo:502: 00000100:00100000:1.0:1789135615.065625:0:7848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.065671:0:7848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc10bd8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135615.065783:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545021824 00000100:00100000:2.0:1789135615.065790:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545021824 00000100:00100000:2.0:1789135615.065834:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789135615.065843:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:7848:x1876044545021824:12345-0@lo:502: 00000100:00100000:2.0:1789135615.066173:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:7848:x1876044545021824:12345-0@lo:502: Request processed in 330us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135615.066180:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789135615.067213:0:7848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7848:1876044545021824:0@lo:502: 00000020:01000000:1.0:1789135615.067248:0:7848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789135615.067255:0:7848:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789135615.067262:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135615.067264:0:7848:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789135615.067269:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789135615.067273:0:7848:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.135@tcp to nid 0x20000c0a8ce87 (192.168.206.135@tcp) 00000020:01000000:1.0:1789135615.067294:0:7848:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789135615.067296:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789135615.067310:0:7848:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8adb01d00000) 00000020:00000080:1.0:1789135615.067332:0:7848:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789135615.067337:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789135615.067414:0:7848:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789135615.067432:0:7848:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789135615.067440:0:7848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce3eab 00010000:00080000:1.0:1789135615.067465:0:7848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adc3929f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1789135615.067822:0:7848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789135615.068170:0:7848:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789135615.068182:0:7848:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789135615.069184:0:7848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135615.069615:0:7848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135615.069669:0:7848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789135615.069815:0:7848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:2.0:1789135615.072954:0:7848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789135615.072968:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789135615.073000:0:7848:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789135615.073020:0:7848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce3eb2 00000100:00080000:2.0:1789135615.073047:0:7848:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135615.073053:0:7848:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adc3929f000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1789135615.073109:0:7848:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc1954ed00 x1876044545021952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135615.073133:0:7848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789135615.073181:0:7848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135615.073186:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135615.073188:0:7848:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789135615.073191:0:7848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135615.073194:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135615.073195:0:7848:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789135615.073198:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135615.073200:0:7848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789135615.073226:0:7848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7848:1876044545022080:0@lo:502: 00000100:00100000:2.0:1789135615.073295:0:7848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135615.073324:0:7848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.073504:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545021952:0@lo:8: 00000100:00100000:1.0:1789135615.073539:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.073579:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545022080 00000100:00100000:1.0:1789135615.073585:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545022080 00000100:00100000:1.0:1789135615.073620:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789135615.073628:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:7848:x1876044545022080:12345-0@lo:502: 00000100:00100000:1.0:1789135615.073850:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:7848:x1876044545022080:12345-0@lo:502: Request processed in 222us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.073857:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789135615.073989:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545021952 00000100:00100000:2.0:1789135615.073993:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545021952 00000100:00100000:2.0:1789135615.074019:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135615.074024:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3312:x1876044545021952:12345-0@lo:8: 00010000:00080000:2.0:1789135615.074051:0:6765:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1789135615.074093:0:6765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce3eb9 00002000:00100000:2.0:1789135615.074107:0:6765:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8adc41d67000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113983 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789135615.074111:0:6765:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789135615.074115:0:6765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789135615.074214:0:6765:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789135615.074347:0:6765:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789135615.074370:0:6765:0:(import.c:65:import_set_state_nolock()) ffff8adc41d64800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135615.074419:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044545021952:12345-0@lo:8: Request processed in 392us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135615.074425:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135615.074459:0:7848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:7848:1876044545022080:0@lo:502: 00000020:01000000:2.0:1789135615.074488:0:7848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135615.074494:0:7848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135615.074495:0:7848:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789135615.074499:0:7848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789135615.074553:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789135615.074568:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789135615.074579:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.074589:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135615.074599:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789135615.074601:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adc06b64ed8 from 1 10000000:01000000:2.0:1789135615.074604:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789135615.074629:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.074637:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.074645:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135615.074659:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545022208:0@lo:101: 00010000:00080000:1.0:1789135615.074858:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc1954ed00 x1876044545021952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135615.074868:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789135615.074885:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789135615.074894:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789135615.074898:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789135615.074901:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc3929f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789135615.074910:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789135615.074914:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545021952:0@lo:8: 00000100:00100000:2.0:1789135615.075399:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135615.075435:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.076730:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545022208 00000100:00100000:1.0:1789135615.076740:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545022208 00000100:00100000:1.0:1789135615.076791:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789135615.076800:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545022208:12345-0@lo:101: 00010000:00010000:1.0:1789135615.076814:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135615.076831:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3ec0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.076857:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.076890:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135615.076899:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481400, rc 0) 00000100:00100000:1.0:1789135615.076953:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545022208:12345-0@lo:101: Request processed in 154us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.076960:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789135615.079829:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545022208:0@lo:101: 00010000:00010000:2.0:1789135615.079895:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.079908:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135615.080986:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545022336:0@lo:501: 00000100:00100000:2.0:1789135615.082996:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135615.083031:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.086466:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545022336 00000100:00100000:1.0:1789135615.086479:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545022336 00000100:00100000:1.0:1789135615.086534:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789135615.086543:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545022336:12345-0@lo:501: 00000100:00100000:1.0:1789135615.087929:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545022336:12345-0@lo:501: Request processed in 1383us (4933us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135615.087941:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789135615.088804:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545022336:0@lo:501: 10000000:01000000:2.0:1789135615.088845:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789135615.088855:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135615.088864:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135615.089505:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545022464:0@lo:400: 00000100:00100000:1.0:1789135615.089560:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.089608:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545022464 00000100:00100000:1.0:1789135615.089614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545022464 00000100:00100000:1.0:1789135615.089654:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135615.089662:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545022464:12345-0@lo:400: 00000100:00100000:3.0:1789135615.089809:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545022592:0@lo:400: 00000100:00100000:3.0:1789135615.089839:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135615.089860:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135615.089866:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545022720:0@lo:400: 00000100:00100000:3.0:1789135615.089915:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135615.089940:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789135615.089946:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789135615.089959:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545022720 00000100:00100000:3.0:1789135615.089962:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545022720 00000100:00100000:3.0:1789135615.089992:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135615.090004:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545022720:12345-0@lo:400: 00000100:00100000:3.0:1789135615.090058:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545022720:12345-0@lo:400: Request processed in 53us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135615.090087:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789135615.090106:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135615.090127:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc194552c0 x1876044545022720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135615.090140:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545022720:0@lo:400: 00000040:00080000:3.0:1789135615.090230:0:7849:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135615.090234:0:7849:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1789135615.090269:0:7849:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789135615.090596:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545022464:12345-0@lo:400: Request processed in 934us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.090604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135615.090628:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545022592 00000100:00100000:1.0:1789135615.090632:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545022592 00000100:00100000:1.0:1789135615.090660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000004:00080000:3.0:1789135615.090839:0:7849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238662774861ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789135615.091192:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545022592:12345-0@lo:400: 00000100:00100000:1.0:1789135615.091242:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545022592:12345-0@lo:400: Request processed in 569us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.091250:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789135615.091284:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545022848:0@lo:400: 00000100:00100000:1.0:1789135615.091314:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789135615.091359:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc19454780 x1876044545022464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135615.091371:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545022464:0@lo:400: 00000100:00080000:1.0:1789135615.091389:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135615.091411:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545022848 00000100:00100000:1.0:1789135615.092123:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545022848 00000100:00100000:1.0:1789135615.092172:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789135615.092179:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545022848:12345-0@lo:400: 00000100:00100000:1.0:1789135615.092227:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545022848:12345-0@lo:400: Request processed in 49us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.092233:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789135615.092258:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789135615.092281:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc19454b40 x1876044545022848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135615.092292:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545022848:0@lo:400: 00010000:00080000:3.0:1789135615.101267:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc19454f00 x1876044545022592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135615.101285:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545022592:0@lo:400: 00000004:00080000:1.0:1789135615.195822:0:7850:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789135615.195853:0:7850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7850:1876044545023104:0@lo:7: 00000100:00100000:1.0:1789135615.195926:0:7850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.195973:0:7850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0385d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.196029:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545022976:0@lo:13: 00000100:00100000:1.0:1789135615.196056:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.196111:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545022976 00000100:00100000:1.0:1789135615.196117:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545022976 00000100:00100000:1.0:1789135615.196171:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135615.196181:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545022976:12345-0@lo:13: 00002000:00000024:1.0:1789135615.196216:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789135615.196259:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545022976:12345-0@lo:13: Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135615.196267:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789135615.196297:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789135615.196323:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3787e940 x1876044545022976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135615.196342:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545022976:0@lo:13: 00000100:00100000:2.0:1789135615.196754:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545023104 00000100:00100000:2.0:1789135615.196760:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545023104 00000100:00100000:2.0:1789135615.196793:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135615.196800:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7850:x1876044545023104:12345-0@lo:7: 00002000:00080000:2.0:1789135615.213471:0:6765:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789135615.213478:0:6765:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789135615.213584:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7850:x1876044545023104:12345-0@lo:7: Request processed in 16780us (17654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135615.213595:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789135615.216191:0:7850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3787f480 x1876044545023104/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789135631 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135615.216211:0:7850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7850:1876044545023104:0@lo:7: 00000004:00080000:1.0:1789135615.216226:0:7850:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789135615.216260:0:7850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7850:1876044545023232:0@lo:5: 00000100:00100000:1.0:1789135615.216313:0:7850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.216357:0:7850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0385d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.216437:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545023232 00000100:00100000:1.0:1789135615.216443:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545023232 00000100:00100000:1.0:1789135615.216485:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135615.216493:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7850:x1876044545023232:12345-0@lo:5: 00002000:00080000:1.0:1789135615.216518:0:6682:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789135615.216527:0:6682:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789135615.216860:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7850:x1876044545023232:12345-0@lo:5: Request processed in 367us (545us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789135615.216868:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789135615.216925:0:7850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3787f480 x1876044545023232/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135631 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135615.216936:0:7850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7850:1876044545023232:0@lo:5: 00000004:00080000:1.0:1789135615.216945:0:7850:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789135615.216970:0:7850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7850:1876044545023360:0@lo:700: 00000100:00100000:1.0:1789135615.216996:0:7850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.217012:0:7850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12178780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.217024:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545023360 00000100:00100000:1.0:1789135615.217027:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545023360 00000100:00100000:1.0:1789135615.217053:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135615.217080:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7850:x1876044545023360:12345-0@lo:700: 00000100:00100000:1.0:1789135615.217108:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1876044545023488:0@lo:700: 00000100:00100000:1.0:1789135615.217134:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135615.217150:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0385d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.217180:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545023488 00000100:00100000:1.0:1789135615.217184:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545023488 00000100:00100000:1.0:1789135615.217210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135615.217216:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1876044545023488:12345-0@lo:700: 00000004:00080000:3.0:1789135615.264900:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1789135615.307370:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00010000:00080000:1.0:1789135615.323832:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc194ed2c0 x1876044545023488/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789135631 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135615.323851:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1876044545023488:0@lo:700: 40000000:02000000:1.0:1789135615.323866:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1789135615.326663:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1876044545023488:12345-0@lo:700: Request processed in 109437us (109518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135615.327215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135615.418407:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7850:x1876044545023360:12345-0@lo:700: Request processed in 201339us (201401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135615.418420:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:2.0:1789135615.419404:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1789135615.419422:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1789135615.419529:0:7850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc194ecb40 x1876044545023360/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789135631 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135615.419547:0:7850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7850:1876044545023360:0@lo:700: 00000004:02000040:1.0:1789135615.520377:0:7850:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789135615.538590:0:7850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7850:1876044545023616:0@lo:5: 00000100:00100000:2.0:1789135615.538661:0:7850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135615.538737:0:7850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07d6e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135615.538893:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545023616 00000100:00100000:1.0:1789135615.538901:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545023616 00000100:00100000:1.0:1789135615.538954:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135615.538964:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7850:x1876044545023616:12345-0@lo:5: 00002000:00080000:2.0:1789135615.552134:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789135615.552155:0:6681:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789135615.557673:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7850:x1876044545023616:12345-0@lo:5: Request processed in 18701us (19002us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789135615.557687:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789135615.558293:0:7850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc1954fc00 x1876044545023616/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135631 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135615.558308:0:7850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789135615.558324:0:7850:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8adc1954fc00 x1876044545023616/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135631 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135615.558336:0:7850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7850:1876044545023616:0@lo:5: 00000004:00080000:3.0:1789135615.558358:0:7850:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789135615.696912:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135616.529763:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135616.529795:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545023744:0@lo:13: 00000100:00100000:1.0:1789135616.529856:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135616.530129:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545023744 00000100:00100000:3.0:1789135616.530137:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545023744 00000100:00100000:3.0:1789135616.530253:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789135616.530274:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545023744:12345-0@lo:13: 00002000:00000024:3.0:1789135616.530308:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135616.530358:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545023744:12345-0@lo:13: Request processed in 87us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135616.530365:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789135616.534489:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc156f6940 x1876044545023744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135616.534515:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545023744:0@lo:13: 00010000:00010000:0.0:1789135616.716510:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135617.500626:0:7984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789135617.741804:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135618.764600:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135619.788592:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135620.108437:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545024128:0@lo:400: 00000100:00100000:0.0:1789135620.108501:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135620.108564:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789135620.108570:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545024000:0@lo:400: 00000100:00100000:0.0:1789135620.108593:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135620.108613:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545024512:0@lo:400: 00000100:00100000:0.0:1789135620.108642:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135620.108648:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545024128 00000100:00100000:2.0:1789135620.108657:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545024128 00000100:00100000:0.0:1789135620.108677:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545024000 00000100:00100000:0.0:1789135620.108682:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545024000 00000100:00100000:2.0:1789135620.108718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135620.108725:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135620.108731:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545024128:12345-0@lo:400: 00000100:00100000:0.0:1789135620.108738:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545024000:12345-0@lo:400: 00000100:00100000:2.0:1789135620.108791:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545024128:12345-0@lo:400: Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135620.108799:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789135620.108821:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135620.108843:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545024512 00000100:00100000:2.0:1789135620.108857:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545024512 00000100:00100000:2.0:1789135620.108887:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135620.108893:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545024512:12345-0@lo:400: 00000100:00100000:2.0:1789135620.108937:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545024512:12345-0@lo:400: Request processed in 44us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135620.108960:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789135620.108966:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545024000:12345-0@lo:400: Request processed in 231us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135620.108974:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789135620.108990:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135620.109015:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41d7a940 x1876044545024000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135620.109028:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545024000:0@lo:400: 00010000:00080000:0.0:1789135620.109039:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41d7b480 x1876044545024512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135620.109056:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545024512:0@lo:400: 00010000:00080000:0.0:1789135620.109114:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41d78b40 x1876044545024128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135620.109123:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545024128:0@lo:400: 00000100:00100000:3.0:1789135620.109295:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545023872:0@lo:400: 00000100:00100000:3.0:1789135620.109329:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135620.109364:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545024384:0@lo:400: 00000100:00100000:3.0:1789135620.109385:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135620.109411:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135620.109417:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545024256:0@lo:400: 00000100:00100000:3.0:1789135620.109439:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135620.109615:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545024384 00000100:00100000:0.0:1789135620.109620:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545024384 00000100:00100000:0.0:1789135620.109659:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789135620.109665:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545024384:12345-0@lo:400: 00000100:00080000:3.0:1789135620.109905:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789135620.109927:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41d78f00 x1876044545024384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135620.109945:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545024384:0@lo:400: 00000100:00100000:0.0:1789135620.110041:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545024384:12345-0@lo:400: Request processed in 376us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135620.110049:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135620.110486:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545023872 00000100:00100000:2.0:1789135620.110493:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545023872 00000100:00100000:2.0:1789135620.110543:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789135620.110550:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545023872:12345-0@lo:400: 00000100:00100000:2.0:1789135620.110612:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545023872:12345-0@lo:400: Request processed in 63us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135620.110619:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789135620.110650:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545024256 00000100:00100000:2.0:1789135620.110654:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545024256 00000100:00100000:2.0:1789135620.110688:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789135620.110695:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545024256:12345-0@lo:400: 00000100:00100000:2.0:1789135620.110729:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545024256:12345-0@lo:400: Request processed in 35us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135620.110736:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789135620.111106:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135620.111603:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41d7b840 x1876044545024256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135620.111618:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545024256:0@lo:400: 00000100:00100000:0.0:1789135620.111632:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545023872:0@lo:400: 00000100:00100000:3.0:1789135620.627364:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545024640:0@lo:13: 00000100:00100000:3.0:1789135620.627442:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135620.628726:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545024640 00000100:00100000:3.0:1789135620.628736:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545024640 00000100:00100000:3.0:1789135620.628781:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135620.628791:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545024640:12345-0@lo:13: 00002000:00000024:3.0:1789135620.628825:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135620.628896:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545024640:12345-0@lo:13: Request processed in 107us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135620.628903:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789135620.631680:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc156f6940 x1876044545024640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135620.631707:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545024640:0@lo:13: 00000001:00080000:2.0:1789135620.761674:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789135620.814554:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135621.644181:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545024768:0@lo:13: 00000100:00100000:3.0:1789135621.644240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135621.644301:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545024768 00000100:00100000:3.0:1789135621.644307:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545024768 00000100:00100000:3.0:1789135621.644341:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135621.644348:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19457840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545024768:12345-0@lo:13: 00002000:00000024:3.0:1789135621.644377:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135621.644410:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19457840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545024768:12345-0@lo:13: Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135621.644416:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789135621.644466:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc156f6940 x1876044545024768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135621.644482:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545024768:0@lo:13: 00010000:00010000:1.0:1789135621.839739:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135622.860616:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135623.884277:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135624.507397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135624.507837:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512493952 00000100:00100000:1.0:1789135624.507846:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512493952 00000100:00100000:1.0:1789135624.507994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:1.0:1789135624.508002:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2374:x1876044512493952:12345-192.168.206.35@tcp:250: 00010000:00080000:1.0:1789135624.508038:0:5832:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from c10fadf3-edc6-4c88-b194-561a01ca971d@192.168.206.35@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:1.0:1789135624.508107:0:5832:0:(genops.c:1385:class_connect()) connect: client c10fadf3-edc6-4c88-b194-561a01ca971d, cookie 0x5b09da6ee1ce3ece 00000100:00080000:1.0:1789135624.508237:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8adc41d44800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135624.508307:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+5:2374:x1876044512493952:12345-192.168.206.35@tcp:250: Request processed in 304us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135624.508324:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:3.0:1789135624.512365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135624.512911:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512493824 00000100:00100000:2.0:1789135624.512921:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512493824 00000100:00100000:2.0:1789135624.512986:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:2.0:1789135624.512998:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+5:5606:x1876044512493824:12345-192.168.206.35@tcp:101: 00010000:00010000:2.0:1789135624.513014:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135624.513031:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d341c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135624.513172:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135624.513184:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135624.513194:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2000, rc 0) 00000100:00100000:2.0:1789135624.513254:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+6:5606:x1876044512493824:12345-192.168.206.35@tcp:101: Request processed in 258us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135624.513261:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:3.0:1789135624.520175:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135624.522574:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512494080 00000100:00100000:2.0:1789135624.522588:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512494080 00000100:00100000:2.0:1789135624.522659:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:2.0:1789135624.522668:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+6:5606:x1876044512494080:12345-192.168.206.35@tcp:501: 00000100:00100000:2.0:1789135624.523050:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+6:5606:x1876044512494080:12345-192.168.206.35@tcp:501: Request processed in 382us (2883us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789135624.523059:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:3.0:1789135624.529191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135624.533751:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512494208 00000100:00100000:1.0:1789135624.533766:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512494208 00000100:00100000:1.0:1789135624.533846:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:1.0:1789135624.533857:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+6:5606:x1876044512494208:12345-192.168.206.35@tcp:101: 00010000:00010000:1.0:1789135624.533888:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135624.533907:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3423 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135624.533934:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135624.533944:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135624.533954:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481e00, rc 0) 00000100:00100000:1.0:1789135624.534020:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+7:5606:x1876044512494208:12345-192.168.206.35@tcp:101: Request processed in 165us (4837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135624.534027:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:0.0:1789135624.538795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135624.539679:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512494336 00000100:00100000:3.0:1789135624.539689:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512494336 00000100:00100000:3.0:1789135624.539752:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:3.0:1789135624.539762:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+7:5606:x1876044512494336:12345-192.168.206.35@tcp:501: 00000100:00100000:3.0:1789135624.540091:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5606:x1876044512494336:12345-192.168.206.35@tcp:501: Request processed in 301us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135624.540100:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:3.0:1789135624.543996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135624.544172:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512494464 00000100:00100000:2.0:1789135624.544182:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512494464 00000100:00100000:2.0:1789135624.544239:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:2.0:1789135624.544249:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5606:x1876044512494464:12345-192.168.206.35@tcp:503: 00000100:00100000:2.0:1789135624.545294:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5606:x1876044512494464:12345-192.168.206.35@tcp:503: Request processed in 1042us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135624.545303:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:2.0:1789135624.551014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135624.551154:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512494592 00000100:00100000:1.0:1789135624.551164:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512494592 00000100:00100000:1.0:1789135624.551220:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:1.0:1789135624.551231:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5624:x1876044512494592:12345-192.168.206.35@tcp:502: 00000100:00100000:1.0:1789135624.551989:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5624:x1876044512494592:12345-192.168.206.35@tcp:502: Request processed in 756us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135624.551999:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:0.0:1789135624.631977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135624.632094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512494720 00000100:00100000:2.0:1789135624.632104:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512494720 00000100:00100000:2.0:1789135624.632160:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:2.0:1789135624.632170:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5624:x1876044512494720:12345-192.168.206.35@tcp:502: 00000100:00100000:2.0:1789135624.632980:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5624:x1876044512494720:12345-192.168.206.35@tcp:502: Request processed in 809us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135624.632989:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:2.0:1789135624.635860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135624.635946:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512494848 00000100:00100000:1.0:1789135624.635955:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512494848 00000100:00100000:1.0:1789135624.636004:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:1.0:1789135624.636013:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5606:x1876044512494848:12345-192.168.206.35@tcp:101: 00010000:00010000:1.0:1789135624.636029:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135624.636045:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01480600/0x5b09da6ee1ce3ee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d344d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135624.636125:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01480600/0x5b09da6ee1ce3ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d344d expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135624.636136:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01480600/0x5b09da6ee1ce3ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d344d expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135624.636144:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480600, rc 0) 00000100:00100000:1.0:1789135624.636193:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5606:x1876044512494848:12345-192.168.206.35@tcp:101: Request processed in 180us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135624.636199:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:0.0:1789135624.647812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135624.647992:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512494976 00000100:00100000:2.0:1789135624.648001:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512494976 00000100:00100000:2.0:1789135624.648057:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:2.0:1789135624.648159:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5606:x1876044512494976:12345-192.168.206.35@tcp:256: 20000000:01000000:2.0:1789135624.648183:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789135624.648205:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789135624.648208:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789135624.648211:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789135624.648213:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789135624.650671:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5606:x1876044512494976:12345-192.168.206.35@tcp:256: Request processed in 2509us (2859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135624.650684:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:3.0:1789135624.654034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135624.654212:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512495104 00000100:00100000:2.0:1789135624.654222:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512495104 00000100:00100000:2.0:1789135624.654332:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00100000:2.0:1789135624.654343:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5606:x1876044512495104:12345-192.168.206.35@tcp:101: 00010000:00010000:2.0:1789135624.654358:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135624.654373:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3454 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135624.654439:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135624.654451:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135624.654460:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2200, rc 0) 00000100:00100000:2.0:1789135624.654527:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5606:x1876044512495104:12345-192.168.206.35@tcp:101: Request processed in 187us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135624.654534:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00100000:0.0:1789135624.657745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135624.657840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512495232 00000100:00100000:1.0:1789135624.657849:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512495232 00000100:00100000:1.0:1789135624.657902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 125 00000100:00100000:1.0:1789135624.657911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5606:x1876044512495232:12345-192.168.206.35@tcp:501: 00000100:00100000:1.0:1789135624.658199:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5606:x1876044512495232:12345-192.168.206.35@tcp:501: Request processed in 288us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135624.658207:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 125 00000100:00100000:0.0:1789135624.660051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135624.660152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512495360 00000100:00100000:1.0:1789135624.660159:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512495360 00000100:00100000:1.0:1789135624.660198:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:1.0:1789135624.660206:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5606:x1876044512495360:12345-192.168.206.35@tcp:503: 00000100:00100000:1.0:1789135624.664334:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5606:x1876044512495360:12345-192.168.206.35@tcp:503: Request processed in 517us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135624.664348:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:0.0:1789135624.667288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135624.667433:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512495488 00000100:00100000:3.0:1789135624.667442:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512495488 00000100:00100000:3.0:1789135624.667630:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 127 00000100:00100000:3.0:1789135624.667641:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5631:x1876044512495488:12345-192.168.206.35@tcp:502: 00000100:00100000:3.0:1789135624.667908:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5631:x1876044512495488:12345-192.168.206.35@tcp:502: Request processed in 268us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135624.667916:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 127 00000100:00100000:0.0:1789135624.675735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135624.675920:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512495616 00000100:00100000:3.0:1789135624.675930:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512495616 00000100:00100000:3.0:1789135624.675981:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00100000:3.0:1789135624.675992:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5631:x1876044512495616:12345-192.168.206.35@tcp:502: 00000100:00100000:3.0:1789135624.676266:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5631:x1876044512495616:12345-192.168.206.35@tcp:502: Request processed in 275us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135624.676275:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00100000:0.0:1789135624.680045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135624.680257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512495744 00000100:00100000:1.0:1789135624.680271:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512495744 00000100:00100000:1.0:1789135624.680315:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:1.0:1789135624.680322:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2374:x1876044512495744:12345-192.168.206.35@tcp:38: 00010000:00080000:1.0:1789135624.680351:0:5837:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:1.0:1789135624.680635:0:5837:0:(genops.c:1385:class_connect()) connect: client 5f7ef768-1508-4eda-9824-c10078b0a61e, cookie 0x5b09da6ee1ce3ef1 00000004:00100000:1.0:1789135624.680663:0:5837:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789135624.680670:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789135624.724335:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8adc03e06800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135624.724479:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2374:x1876044512495744:12345-192.168.206.35@tcp:38: Request processed in 44154us (44440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135624.724490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00010000:00010000:1.0:1789135624.908272:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135625.232468:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545025024:0@lo:400: 00000100:00100000:2.0:1789135625.232537:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135625.232598:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545025536:0@lo:400: 00000100:00100000:2.0:1789135625.232628:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135625.232660:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135625.232666:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545025152:0@lo:400: 00000100:00100000:2.0:1789135625.232690:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135625.232721:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545025024 00000100:00100000:2.0:1789135625.232727:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545025024 00000100:00100000:2.0:1789135625.232772:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545025152 00000100:00100000:2.0:1789135625.232776:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545025152 00000100:00100000:3.0:1789135625.232876:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545024896:0@lo:400: 00000100:00100000:3.0:1789135625.232911:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135625.232936:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545025408:0@lo:400: 00000100:00100000:3.0:1789135625.232959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135625.233196:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545025280:0@lo:400: 00000100:00100000:0.0:1789135625.233226:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135625.233260:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545025536 00000100:00100000:0.0:1789135625.233264:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545025536 00000100:00100000:0.0:1789135625.233294:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545025280 00000100:00100000:0.0:1789135625.233297:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545025280 00000100:00100000:0.0:1789135625.233323:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135625.233332:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545025536:12345-0@lo:400: 00000100:00100000:0.0:1789135625.233401:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545025536:12345-0@lo:400: Request processed in 70us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135625.233409:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135625.233427:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135625.233433:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545025280:12345-0@lo:400: 00000100:00100000:0.0:1789135625.233466:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545025280:12345-0@lo:400: Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135625.233472:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789135625.233508:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342bbc00 x1876044545025280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135625.233522:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545025280:0@lo:400: 00010000:00080000:0.0:1789135625.233552:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342b9a40 x1876044545025536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135625.233560:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789135625.233570:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545025536:0@lo:400: 00000100:00080000:3.0:1789135625.241001:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135625.241009:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135625.241012:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135625.246039:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545025408 00000100:00100000:2.0:1789135625.246053:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545025408 00000100:00100000:2.0:1789135625.246149:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789135625.246159:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545025024:12345-0@lo:400: 00000100:00100000:2.0:1789135625.246246:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545025024:12345-0@lo:400: Request processed in 88us (13709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135625.246266:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789135625.246283:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789135625.246291:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545025152:12345-0@lo:400: 00000100:00100000:2.0:1789135625.246324:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545025152:12345-0@lo:400: Request processed in 35us (13634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135625.246330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789135625.246345:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789135625.246352:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545025408:12345-0@lo:400: 00000100:00100000:2.0:1789135625.246399:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545025408:12345-0@lo:400: Request processed in 48us (13438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135625.246405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789135625.246427:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789135625.246463:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342b83c0 x1876044545025408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135625.246477:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545025408:0@lo:400: 00010000:00080000:2.0:1789135625.246510:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342ba1c0 x1876044545025152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135625.246520:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545025152:0@lo:400: 00010000:00080000:2.0:1789135625.246531:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342b8000 x1876044545025024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135625.246539:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545025024:0@lo:400: 00000100:00100000:2.0:1789135625.246575:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545024896 00000100:00100000:2.0:1789135625.246579:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545024896 00000100:00100000:2.0:1789135625.246603:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789135625.246615:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545024896:12345-0@lo:400: 00000100:00100000:2.0:1789135625.246944:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545024896:12345-0@lo:400: Request processed in 329us (14031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135625.246951:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789135625.246999:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545024896:0@lo:400: 00000100:00100000:1.0:1789135625.736845:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135625.736890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135625.736992:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512496000 00000100:00100000:3.0:1789135625.736993:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512495872 00000100:00100000:3.0:1789135625.737004:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512495872 00000100:00100000:2.0:1789135625.737004:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512496000 00000100:00100000:3.0:1789135625.737112:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00080000:0.0:1789135625.737113:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135625.737125:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:0:x1876044512495872:12345-192.168.206.35@tcp:41: 00000004:00000024:3.0:1789135625.737169:0:7852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789135625.737241:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:0:x1876044512495872:12345-192.168.206.35@tcp:41: Request processed in 120us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135625.737248:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:3.0:1789135625.737269:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1789135625.737278:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5606:x1876044512496000:12345-192.168.206.35@tcp:41: 00000004:00000024:3.0:1789135625.737289:0:7852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789135625.737314:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5606:x1876044512496000:12345-192.168.206.35@tcp:41: Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135625.737321:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:0.0:1789135625.743900:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545025664:0@lo:13: 00000100:00100000:0.0:1789135625.743978:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135625.747863:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545025664 00000100:00100000:3.0:1789135625.747877:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545025664 00000100:00100000:3.0:1789135625.747938:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789135625.747947:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545025664:12345-0@lo:13: 00002000:00000024:3.0:1789135625.747980:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135625.748095:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545025664:12345-0@lo:13: Request processed in 149us (4117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135625.748103:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789135625.748164:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41d78b40 x1876044545025664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135625.748186:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545025664:0@lo:13: 00000100:00100000:0.0:1789135625.751314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135625.751507:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512496128 00000100:00100000:2.0:1789135625.751516:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512496128 00000100:00100000:2.0:1789135625.751573:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:2.0:1789135625.751583:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5606:x1876044512496128:12345-192.168.206.35@tcp:40: 00000100:00100000:2.0:1789135625.751672:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5606:x1876044512496128:12345-192.168.206.35@tcp:40: Request processed in 90us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135625.751689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1789135625.761117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135625.761269:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512496256 00000100:00100000:2.0:1789135625.761279:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512496256 00000100:00100000:2.0:1789135625.761325:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:2.0:1789135625.761333:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2374:x1876044512496256:12345-192.168.206.35@tcp:8: 00010000:00080000:2.0:1789135625.761379:0:6765:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1789135625.761417:0:6765:0:(genops.c:1385:class_connect()) connect: client 5f7ef768-1508-4eda-9824-c10078b0a61e, cookie 0x5b09da6ee1ce3ef8 00002000:00100000:2.0:1789135625.761429:0:6765:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f7ef768-1508-4eda-9824-c10078b0a61e/ffff8adc41d66000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789135625.761451:0:6765:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789135625.761782:0:6765:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789135625.761811:0:6765:0:(import.c:65:import_set_state_nolock()) ffff8adc41d63800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135625.761893:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2374:x1876044512496256:12345-192.168.206.35@tcp:8: Request processed in 559us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135625.761915:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1789135625.764108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135625.764344:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512496384 00000100:00100000:2.0:1789135625.764354:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512496384 00000100:00100000:2.0:1789135625.764404:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1789135625.764413:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2374:x1876044512496384:12345-192.168.206.35@tcp:8: 00010000:00080000:2.0:1789135625.764446:0:6682:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp t0 exp 0000000000000000 cur 249 last 0 00000020:00000080:2.0:1789135625.764476:0:6682:0:(genops.c:1385:class_connect()) connect: client 5f7ef768-1508-4eda-9824-c10078b0a61e, cookie 0x5b09da6ee1ce3eff 00002000:00100000:2.0:1789135625.764488:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5f7ef768-1508-4eda-9824-c10078b0a61e/ffff8adc41d64000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789135625.764499:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789135625.764860:0:6682:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789135625.764890:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8adc41d61800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135625.764956:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2374:x1876044512496384:12345-192.168.206.35@tcp:8: Request processed in 543us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135625.766245:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:0.0:1789135625.779584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135625.779640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135625.779839:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512496512 00000100:00100000:3.0:1789135625.779849:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512496512 00000100:00100000:3.0:1789135625.779903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:3.0:1789135625.779913:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5606:x1876044512496512:12345-192.168.206.35@tcp:33: 00000100:00100000:1.0:1789135625.780300:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512496640 00000100:00100000:1.0:1789135625.780305:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512496640 00000100:00100000:1.0:1789135625.780347:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 130 00000100:00100000:1.0:1789135625.780355:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512496640:12345-192.168.206.35@tcp:400: 00000100:00100000:1.0:1789135625.780430:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512496640:12345-192.168.206.35@tcp:400: Request processed in 76us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135625.780438:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 130 00000004:00080000:3.0:1789135625.829902:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 49915us 00000004:00200000:3.0:1789135625.856596:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789135625.856780:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5606:x1876044512496512:12345-192.168.206.35@tcp:33: Request processed in 76863us (77201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135625.856790:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00010000:00010000:0.0:1789135625.933768:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135626.061589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135626.061689:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512496768 00000100:00100000:3.0:1789135626.061698:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512496768 00000100:00100000:3.0:1789135626.061765:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1789135626.061775:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5648:x1876044512496768:12345-192.168.206.35@tcp:101: 00010000:00010000:3.0:1789135626.061794:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135626.061875:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc029e4400/0x5b09da6ee1ce3f06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d347e expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135626.061947:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc029e5400/0x5b09da6ee1ce3f0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135626.062164:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc029e5400/0x5b09da6ee1ce3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135626.062182:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc029e5400/0x5b09da6ee1ce3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135626.062380:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789135626.062384:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135626.062633:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc029e5400/0x5b09da6ee1ce3f0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135626.062661:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc029e4400/0x5b09da6ee1ce3f06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d347e expref: 8 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135626.062678:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc029e5400/0x5b09da6ee1ce3f0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d347e expref: 7 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135626.062687:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:3.0:1789135626.062690:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135626.062693:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e5400, rc 0) 00000100:00100000:3.0:1789135626.062892:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:5648:x1876044512496768:12345-192.168.206.35@tcp:101: Request processed in 1118us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135626.063337:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1789135626.764644:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545025792:0@lo:13: 00000100:00100000:0.0:1789135626.764716:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135626.765556:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545025792 00000100:00100000:3.0:1789135626.765566:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545025792 00000100:00100000:3.0:1789135626.765664:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789135626.765675:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545025792:12345-0@lo:13: 00002000:00000024:3.0:1789135626.765700:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135626.765853:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545025792:12345-0@lo:13: Request processed in 179us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135626.765860:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789135626.765948:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc194552c0 x1876044545025792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135626.765968:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545025792:0@lo:13: 00010000:00010000:2.0:1789135626.956725:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135627.980392:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135628.194685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135628.194849:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512496896 00000100:00100000:2.0:1789135628.194857:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512496896 00000100:00100000:2.0:1789135628.194938:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00080000:0.0:1789135628.194938:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135628.194957:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:5701:x1876044512496896:12345-192.168.206.35@tcp:41: 00000004:00000024:2.0:1789135628.194997:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789135628.195098:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:5701:x1876044512496896:12345-192.168.206.35@tcp:41: Request processed in 147us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135628.195107:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:0.0:1789135628.199715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135628.199875:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512497024 00000100:00100000:3.0:1789135628.199885:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512497024 00000100:00100000:3.0:1789135628.200035:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1789135628.200045:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5701:x1876044512497024:12345-192.168.206.35@tcp:13: 00002000:00000024:3.0:1789135628.200111:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135628.200180:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5701:x1876044512497024:12345-192.168.206.35@tcp:13: Request processed in 135us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135628.200188:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00080000:0.0:1789135628.201332:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135628.203845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135628.203978:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512497152 00000100:00100000:3.0:1789135628.203988:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512497152 00000100:00100000:1.0:1789135628.204160:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1789135628.204173:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5701:x1876044512497152:12345-192.168.206.35@tcp:13: 00002000:00000024:1.0:1789135628.204208:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135628.204290:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f7ef768-1508-4eda-9824-c10078b0a61e+6:5701:x1876044512497152:12345-192.168.206.35@tcp:13: Request processed in 120us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135628.204298:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00080000:0.0:1789135628.204568:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1789135628.903565:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00010000:00010000:0.0:1789135629.005261:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135629.908020:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00010000:00010000:2.0:1789135630.028238:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135630.349233:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135630.349265:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545025920:0@lo:400: 00000100:00100000:1.0:1789135630.349330:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135630.349419:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545026048:0@lo:400: 00000100:00100000:1.0:1789135630.349612:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135630.349653:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545026048 00000100:00100000:1.0:1789135630.349660:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545026048 00000100:00100000:1.0:1789135630.349714:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135630.349724:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545026048:12345-0@lo:400: 00000100:00100000:1.0:1789135630.349773:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545026048:12345-0@lo:400: Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135630.349781:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135630.349849:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545026048:0@lo:400: 00000100:00100000:0.0:1789135630.349983:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545025920 00000100:00100000:0.0:1789135630.349988:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545025920 00000100:00100000:0.0:1789135630.350022:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789135630.350030:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545025920:12345-0@lo:400: 00000100:00100000:0.0:1789135630.350105:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545025920:12345-0@lo:400: Request processed in 76us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135630.350122:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789135630.350190:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545025920:0@lo:400: 00000100:00100000:1.0:1789135630.350230:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135630.350236:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545026176:0@lo:400: 00000100:00100000:1.0:1789135630.350823:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135630.350860:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545026176 00000100:00100000:1.0:1789135630.350865:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545026176 00000100:00100000:1.0:1789135630.353764:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135630.353779:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545026176:12345-0@lo:400: 00000100:00100000:1.0:1789135630.353878:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545026176:12345-0@lo:400: Request processed in 99us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135630.353897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789135630.353901:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545026176:0@lo:400: 00000100:00080000:1.0:1789135630.353935:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135630.354000:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135630.354011:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545026304:0@lo:400: 00000100:00100000:1.0:1789135630.354045:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135630.354112:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545026432:0@lo:400: 00000100:00100000:1.0:1789135630.354135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135630.355688:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545026432 00000100:00100000:3.0:1789135630.355699:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545026432 00000100:00100000:3.0:1789135630.355776:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789135630.355785:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545026432:12345-0@lo:400: 00000100:00100000:2.0:1789135630.356111:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545026304 00000100:00100000:2.0:1789135630.356116:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545026304 00000100:00100000:2.0:1789135630.356171:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789135630.356180:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545026304:12345-0@lo:400: 00000100:00100000:3.0:1789135630.356905:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545026432:12345-0@lo:400: Request processed in 1118us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135630.356914:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789135630.357098:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545026432:0@lo:400: 00000100:00080000:1.0:1789135630.357131:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135630.357136:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135630.357708:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545026304:12345-0@lo:400: Request processed in 1528us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135630.357716:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789135630.358343:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342bb0c0 x1876044545026304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135630.358357:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545026304:0@lo:400: 00000100:00100000:3.0:1789135630.360844:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135630.360869:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545026560:0@lo:400: 00000100:00100000:3.0:1789135630.360937:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135630.361025:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545026560 00000100:00100000:0.0:1789135630.361033:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545026560 00000100:00080000:3.0:1789135630.361105:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135630.361126:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135630.361136:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545026560:12345-0@lo:400: 00000100:00100000:0.0:1789135630.361192:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545026560:12345-0@lo:400: Request processed in 57us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135630.361200:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789135630.361224:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7d680 x1876044545026560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135630.361239:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545026560:0@lo:400: 00000001:02000400:0.0:1789135630.531753:0:8289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789135630.860551:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545026688:0@lo:13: 00000100:00100000:3.0:1789135630.860624:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135630.861662:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545026688 00000100:00100000:0.0:1789135630.861672:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545026688 00000100:00100000:0.0:1789135630.861722:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135630.861731:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545026688:12345-0@lo:13: 00002000:00000024:0.0:1789135630.861763:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135630.861843:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545026688:12345-0@lo:13: Request processed in 113us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135630.861850:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789135630.863504:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7c000 x1876044545026688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135630.863532:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545026688:0@lo:13: 00000001:00100000:2.0:1789135630.906610:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00010000:00010000:1.0:1789135631.052624:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135631.297908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135631.297940:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512497408 00000100:00100000:1.0:1789135631.297950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512497408 00000100:00100000:3.0:1789135631.297959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135631.297996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135631.298023:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:1.0:1789135631.298036:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512497408:12345-192.168.206.35@tcp:400: 00000100:00100000:3.0:1789135631.298053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135631.298057:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512497280 00000100:00100000:0.0:1789135631.298086:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512497280 00000100:00080000:3.0:1789135631.298105:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135631.298118:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 132 00000100:00100000:0.0:1789135631.298127:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2378:x1876044512497280:12345-192.168.206.35@tcp:400: 00000100:00100000:1.0:1789135631.298131:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512497408:12345-192.168.206.35@tcp:400: Request processed in 99us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135631.298133:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512497664 00000100:00100000:3.0:1789135631.298140:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512497664 00000100:00100000:1.0:1789135631.298144:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:0.0:1789135631.298155:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2378:x1876044512497280:12345-192.168.206.35@tcp:400: Request processed in 29us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135631.298170:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 132 00000100:00100000:3.0:1789135631.298186:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512497536 00000100:00100000:3.0:1789135631.298190:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512497536 00000100:00100000:0.0:1789135631.298205:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:0.0:1789135631.298215:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512497664:12345-192.168.206.35@tcp:400: 00000100:00100000:3.0:1789135631.298227:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1789135631.298238:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512497536:12345-192.168.206.35@tcp:400: 00000100:00100000:0.0:1789135631.298266:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512497664:12345-192.168.206.35@tcp:400: Request processed in 52us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135631.298274:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:3.0:1789135631.298279:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512497536:12345-192.168.206.35@tcp:400: Request processed in 40us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135631.298290:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00080000:3.0:1789135631.298313:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135631.298316:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135631.885933:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545026816:0@lo:13: 00000100:00100000:0.0:1789135631.885997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135631.886079:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545026816 00000100:00100000:0.0:1789135631.886086:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545026816 00000100:00100000:0.0:1789135631.886134:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789135631.886143:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545026816:12345-0@lo:13: 00002000:00000024:0.0:1789135631.886173:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135631.886215:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545026816:12345-0@lo:13: Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135631.886221:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789135631.886261:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7fc00 x1876044545026816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135631.886278:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545026816:0@lo:13: 00010000:00010000:0.0:1789135632.077369:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135633.100193:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789135633.560815:0:8438:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8fda85f0 20000000:00000080:2.0:1789135633.560831:0:8438:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc41db7c00 uarg=0000000000000000 20000000:01000000:2.0:1789135633.560925:0:8438:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789135633.560928:0:8438:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789135633.560930:0:8438:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789135633.560935:0:8438:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789135633.560940:0:8438:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789135633.560953:0:8438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789135633.560956:0:8438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789135633.561330:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789135633.561333:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789135633.561997:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789135633.562414:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789135633.562498:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789135633.562539:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1789135633.562553:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789135633.562555:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789135633.563768:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789135633.564830:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789135633.564883:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789135633.564917:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789135633.564930:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789135633.564933:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789135633.566645:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789135633.566973:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789135633.567006:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789135633.567035:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789135633.567044:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789135633.567051:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789135633.568213:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789135633.568615:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789135633.568915:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789135633.568963:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1789135633.568980:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789135633.568997:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569015:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569023:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569030:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569036:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569043:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569049:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569056:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569097:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569105:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569120:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569157:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569173:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 9 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.569188:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545026944:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135633.569284:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569293:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 9 pid: 5831 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.569302:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027072:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135633.569333:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569341:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 18 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.569350:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027200:0@lo:104: 00000100:00100000:0.0:1789135633.569387:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135633.569418:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569437:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 18 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.569446:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027328:0@lo:104: 00000100:00100000:0.0:1789135633.569471:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135633.569498:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569506:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 18 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.569513:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027456:0@lo:104: 00010000:00010000:0.0:1789135633.569534:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569542:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 18 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.569549:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027584:0@lo:104: 00010000:00010000:0.0:1789135633.569587:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569595:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 18 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.569604:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027712:0@lo:104: 00010000:00010000:0.0:1789135633.569627:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.569648:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 18 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.569997:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789135633.570021:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135633.570038:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135633.570050:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135633.570058:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545027200 00000100:00100000:1.0:1789135633.570092:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545027200 00000100:00100000:1.0:1789135633.570130:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545027328 00000100:00100000:1.0:1789135633.570133:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545027328 00000100:00100000:1.0:1789135633.570143:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545027456 00000100:00100000:1.0:1789135633.570146:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545027456 00000100:00100000:1.0:1789135633.570165:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545027584 00000100:00100000:1.0:1789135633.570168:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545027584 00000100:00100000:1.0:1789135633.570176:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545027712 00000100:00100000:1.0:1789135633.570177:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545027712 00000100:00100000:1.0:1789135633.570188:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789135633.570196:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+7:8438:x1876044545027200:12345-0@lo:104: 00010000:00010000:1.0:1789135633.570209:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.570259:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135633.570265:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+7:8438:x1876044545027200:12345-0@lo:104: Request processed in 70us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135633.570271:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789135633.570287:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135633.570296:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.570301:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789135633.570310:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2800 already unused, calling callback (ffffffffc1a63c20) 00000100:00100000:1.0:1789135633.570313:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+6:8438:x1876044545027328:12345-0@lo:104: 10000000:00010000:2.0:1789135633.570317:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.570323:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570329:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135633.570338:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135633.570345:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135633.570364:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135633.570370:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+6:8438:x1876044545027328:12345-0@lo:104: Request processed in 61us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135633.570377:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1789135633.570378:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570387:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135633.570408:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.570414:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789135633.570422:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce3ec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ec7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.570426:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342ba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+5:8438:x1876044545027456:12345-0@lo:104: 00010000:00010000:1.0:1789135633.570440:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570449:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135633.570454:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570460:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135633.570470:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.570476:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789135633.570478:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135633.570489:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.570493:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342ba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+5:8438:x1876044545027456:12345-0@lo:104: Request processed in 67us (470us total) trans 0 rc 0/0 10000000:01000000:2.0:1789135633.570501:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789135633.570507:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789135633.570520:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.570526:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789135633.570531:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789135633.570537:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:8438:x1876044545027584:12345-0@lo:104: 00010000:00010000:1.0:1789135633.570546:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570549:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570561:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc01481000/0x5b09da6ee1ce3e96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570570:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135633.570573:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570579:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481600 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135633.570582:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570589:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.570596:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135633.570605:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:8438:x1876044545027584:12345-0@lo:104: Request processed in 69us (565us total) trans 0 rc 0/0 10000000:00010000:2.0:1789135633.570613:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.570616:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 10000000:01000000:2.0:1789135633.570624:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789135633.570636:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1789135633.570642:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.570646:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:8438:x1876044545027712:12345-0@lo:104: 00010000:00010000:2.0:1789135633.570656:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135633.570662:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570668:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce3e7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e81 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570677:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135633.570680:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570685:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb3000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135633.570688:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570693:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135633.570699:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135633.570703:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135633.570722:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570728:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135633.570733:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570738:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3e6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e73 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.570748:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135633.570750:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135633.570753:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135633.570767:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545027968:0@lo:103: 00000100:00100000:2.0:1789135633.570823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135633.570858:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135633.570864:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545028352:0@lo:103: 00000100:00100000:2.0:1789135633.571013:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135633.571052:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135633.571080:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545028096:0@lo:103: 00000100:00100000:2.0:1789135633.571104:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135633.571126:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135633.571131:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545028224:0@lo:103: 00000100:00100000:2.0:1789135633.571151:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135633.571173:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545027968 00000100:00100000:2.0:1789135633.571178:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545027968 00010000:00010000:2.0:1789135633.571203:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 19 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135633.571220:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545028352 00000100:00100000:2.0:1789135633.571228:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545028352 00010000:00010000:2.0:1789135633.571241:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 20 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135633.571252:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545028096 00000100:00100000:2.0:1789135633.571254:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545028096 00010000:00010000:2.0:1789135633.571262:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 21 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135633.571270:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545028224 00000100:00100000:2.0:1789135633.571272:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545028224 00010000:00010000:2.0:1789135633.571279:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 22 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135633.571289:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135633.571295:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1857d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+22:3314:x1876044545027968:12345-0@lo:103: 00010000:00010000:2.0:1789135633.571305:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135633.571309:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 22 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.571318:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 22 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.571334:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135633.571364:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1857d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+22:3314:x1876044545027968:12345-0@lo:103: Request processed in 69us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135633.571371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135633.571384:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135633.571390:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41951680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+21:3314:x1876044545028352:12345-0@lo:103: 00010000:00010000:2.0:1789135633.571398:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135633.571408:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 21 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.571416:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 21 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.571426:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135633.571449:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41951680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+21:3314:x1876044545028352:12345-0@lo:103: Request processed in 60us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135633.571456:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135633.571469:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789135633.571477:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+20:3315:x1876044545028096:12345-0@lo:103: 00010000:00010000:2.0:1789135633.571484:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135633.571488:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 20 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.571495:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 20 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.571504:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135633.571530:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+20:3315:x1876044545028096:12345-0@lo:103: Request processed in 55us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135633.571538:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789135633.571552:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135633.571560:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545028224:12345-0@lo:103: 00010000:00010000:2.0:1789135633.571567:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789135633.571568:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789135633.571573:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 19 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135633.571580:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789135633.571597:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 19 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.571607:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135633.571635:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545028224:12345-0@lo:103: Request processed in 76us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135633.571643:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135633.571681:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545028224:0@lo:103: 00000100:00100000:2.0:1789135633.571693:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545028096:0@lo:103: 00000100:00100000:2.0:1789135633.571727:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545028352:0@lo:103: 00000100:00100000:2.0:1789135633.571734:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545027968:0@lo:103: 00000100:00100000:0.0:1789135633.572126:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027840:0@lo:104: 00000100:00100000:0.0:1789135633.572276:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135633.572387:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.572399:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 18 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.572410:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545028480:0@lo:104: 00000100:00100000:0.0:1789135633.572433:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135633.572445:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13625540 going to sleep for 11 seconds 00010000:00010000:0.0:1789135633.572460:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01481400/0x5b09da6ee1ce3ec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ec0 expref: 18 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.572471:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027200:0@lo:104: 00010000:00010000:0.0:1789135633.572480:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce3e9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e96 expref: 17 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.572487:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027328:0@lo:104: 00010000:00010000:0.0:1789135633.572496:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01480a00/0x5b09da6ee1ce3e81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e7a expref: 16 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.572503:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027456:0@lo:104: 00010000:00010000:0.0:1789135633.572511:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01481200/0x5b09da6ee1ce3e73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e6c expref: 15 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.572532:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027584:0@lo:104: 00010000:00010000:1.0:1789135633.572716:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.572769:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135633.572787:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:8438:x1876044545027712:12345-0@lo:104: Request processed in 2133us (2724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135633.572794:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135633.572822:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545027840 00000100:00100000:1.0:1789135633.572827:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545027840 00000100:00100000:1.0:1789135633.572851:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545028480 00000100:00100000:1.0:1789135633.572854:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545028480 00000100:00100000:1.0:1789135633.572867:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135633.572873:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:8438:x1876044545027840:12345-0@lo:104: 00010000:00010000:1.0:1789135633.572881:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.572891:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135633.572896:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.572902:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135633.572906:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.572914:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135633.572921:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135633.572927:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135633.572929:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135633.572934:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:8438:x1876044545027840:12345-0@lo:104: Request processed in 61us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135633.572940:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135633.572954:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789135633.572956:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.572959:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:8438:x1876044545028480:12345-0@lo:104: 00010000:00010000:2.0:1789135633.572962:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135633.572966:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.572977:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.572984:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3e5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.572990:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789135633.572994:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:8438:x1876044545028480:12345-0@lo:104: Request processed in 35us (561us total) trans 0 rc 0/0 00010000:00010000:2.0:1789135633.572995:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789135633.572998:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.573000:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789135633.573004:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb3c00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135633.573006:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.573013:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.573015:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135633.573019:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135633.573020:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.573025:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1a63c20) 10000000:01000000:2.0:1789135633.573026:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789135633.573028:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.573034:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.573038:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135633.573042:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135633.573047:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135633.573081:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.573087:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135633.573101:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.573107:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc01480c00/0x5b09da6ee1ce3e0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e11 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.573117:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135633.573119:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135633.573120:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135633.573126:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789135633.573132:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789135633.573137:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545028864:0@lo:103: 00000100:00100000:1.0:1789135633.573165:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135633.573243:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135633.573436:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.573440:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41953c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545028736:0@lo:103: 00010000:00010000:2.0:1789135633.573454:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3c00/0x5b09da6ee1ce3e34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e3b expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.573466:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135633.573470:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135633.573472:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135633.573473:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135633.573482:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135633.573491:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc419521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545028608:0@lo:103: 00000100:00100000:1.0:1789135633.573503:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545028864 00000100:00100000:1.0:1789135633.573507:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545028864 00000100:00100000:2.0:1789135633.573518:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135633.573523:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 15 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135633.573920:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027712:0@lo:104: 00000100:00100000:2.0:1789135633.573930:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027840:0@lo:104: 00000100:00100000:2.0:1789135633.573936:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545028480:0@lo:104: 00000100:00100000:3.0:1789135633.574473:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545028736 00000100:00100000:3.0:1789135633.574480:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545028736 00010000:00010000:3.0:1789135633.574501:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 16 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135633.574517:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545028608 00000100:00100000:3.0:1789135633.574520:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545028608 00010000:00010000:3.0:1789135633.574537:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 17 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135633.574559:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135633.574568:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+17:3316:x1876044545028864:12345-0@lo:103: 00000100:00100000:3.0:1789135633.574574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789135633.574579:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+17:3316:x1876044545028736:12345-0@lo:103: 00010000:00010000:0.0:1789135633.574580:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135633.574586:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135633.574586:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 17 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135633.574589:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 17 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.574596:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 17 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135633.574760:0:8443:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789135633.574770:0:8443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1789135633.575708:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789135633.575725:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135633.575736:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05775050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+17:3313:x1876044545028608:12345-0@lo:103: 00010000:00010000:1.0:1789135633.575750:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135633.575757:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 17 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135633.575981:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 17 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.576035:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 17 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.576055:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce3e65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e5e expref: 17 pid: 5832 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135633.576088:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135633.576176:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05775050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+16:3313:x1876044545028608:12345-0@lo:103: Request processed in 441us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135633.576184:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135633.576232:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc419521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545028608:0@lo:103: 00010000:00010000:3.0:1789135633.576385:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3e3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e34 expref: 15 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135633.576397:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135633.576438:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+14:3316:x1876044545028736:12345-0@lo:103: Request processed in 1858us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135633.576445:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135633.576694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135633.576718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135633.576740:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512497792 00000100:00100000:2.0:1789135633.576745:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512497792 00010000:00010000:2.0:1789135633.576767:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 10 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135633.576803:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512497920 00000100:00100000:2.0:1789135633.576807:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512497920 00010000:00010000:2.0:1789135633.576819:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 11 pid: 5831 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135633.576830:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1789135633.576837:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c10fadf3-edc6-4c88-b194-561a01ca971d+11:2376:x1876044512497792:12345-192.168.206.35@tcp:103: 00010000:00010000:2.0:1789135633.576855:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135633.576860:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 11 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.576870:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 11 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.576880:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135633.576916:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c10fadf3-edc6-4c88-b194-561a01ca971d+11:2376:x1876044512497792:12345-192.168.206.35@tcp:103: Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135633.576923:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1789135633.576937:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:2.0:1789135633.576945:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41951a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2376:x1876044512497920:12345-192.168.206.35@tcp:103: 00010000:00010000:2.0:1789135633.576952:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135633.576956:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 10 pid: 5831 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.576964:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 10 pid: 5831 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.576976:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.576984:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.576997:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.577014:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.577021:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.577028:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.577034:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135633.577038:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.577047:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.577055:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135633.577093:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135633.577114:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41951a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2376:x1876044512497920:12345-192.168.206.35@tcp:103: Request processed in 171us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135633.577121:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00010000:00010000:0.0:1789135633.577585:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3e11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e0a expref: 13 pid: 5831 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135633.577597:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135633.577645:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+12:3316:x1876044545028864:12345-0@lo:103: Request processed in 3079us (4479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135633.577653:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789135633.577914:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01481e00/0x5b09da6ee1ce3edc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3423 expref: 9 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135633.577925:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545026944:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135633.577937:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2000/0x5b09da6ee1ce3ed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d341c expref: 8 pid: 5831 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135633.577944:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876044545027072:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135633.577977:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135633.577998:0:8438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135633.578004:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135633.578011:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce3f14 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135633.578419:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41953c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545028736:0@lo:103: 00000100:00100000:1.0:1789135633.578428:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545028864:0@lo:103: 00010000:00010000:1.0:1789135634.124744:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135634.956460:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789135634.956467:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adb01c80000 from 39 10000000:01000000:1.0:1789135634.956473:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135634.956520:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.956531:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.956542:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135634.956565:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342bb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545028992:0@lo:101: 00000100:00100000:1.0:1789135634.956675:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.956734:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135634.956843:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545028992 00000100:00100000:2.0:1789135634.956850:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545028992 00000100:00100000:2.0:1789135634.956907:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789135634.956917:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+12:5834:x1876044545028992:12345-0@lo:101: 00010000:00010000:2.0:1789135634.956930:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135634.956944:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb3c00/0x5b09da6ee1ce3f22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3f1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.956985:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb3c00/0x5b09da6ee1ce3f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f1b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.956996:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb3c00/0x5b09da6ee1ce3f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f1b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.957005:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3c00, rc 0) 00000100:00100000:2.0:1789135634.957053:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545028992:12345-0@lo:101: Request processed in 138us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135634.957090:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789135634.957235:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342bb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545028992:0@lo:101: 00010000:00010000:2.0:1789135634.957252:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.957262:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135634.957325:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029120:0@lo:501: 00000100:00100000:2.0:1789135634.957354:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135634.957374:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c84300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135634.957666:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545029120 00000100:00100000:0.0:1789135634.957671:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545029120 00000100:00100000:0.0:1789135634.957702:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789135634.957712:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545029120:12345-0@lo:501: 00000100:00100000:0.0:1789135634.957950:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545029120:12345-0@lo:501: Request processed in 239us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135634.957960:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789135634.958018:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029120:0@lo:501: 00000100:00100000:0.0:1789135634.958102:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029248:0@lo:503: 00000100:00100000:0.0:1789135634.958145:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135634.958176:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc075e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135634.958191:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545029248 00000100:00100000:0.0:1789135634.958195:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545029248 00000100:00100000:0.0:1789135634.958231:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789135634.958239:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545029248:12345-0@lo:503: 00000100:00100000:0.0:1789135634.958393:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545029248:12345-0@lo:503: Request processed in 154us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135634.958399:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789135634.958819:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029248:0@lo:503: 00000100:00100000:1.0:1789135634.960267:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8456:1876044545029376:0@lo:502: 00000100:00100000:1.0:1789135634.960334:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.960371:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135634.960429:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545029376 00000100:00100000:0.0:1789135634.960445:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545029376 00000100:00100000:0.0:1789135634.960488:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789135634.960497:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:8456:x1876044545029376:12345-0@lo:502: 00000100:00100000:0.0:1789135634.960724:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+13:8456:x1876044545029376:12345-0@lo:502: Request processed in 227us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135634.960731:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789135634.961637:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8456:1876044545029376:0@lo:502: 00000100:00100000:2.0:1789135634.961700:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8456:1876044545029504:0@lo:502: 00000100:00100000:2.0:1789135634.961999:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135634.962035:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135634.962708:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545029504 00000100:00100000:0.0:1789135634.962715:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545029504 00000100:00100000:0.0:1789135634.962752:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789135634.962759:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:8456:x1876044545029504:12345-0@lo:502: 00000100:00100000:0.0:1789135634.966295:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+13:8456:x1876044545029504:12345-0@lo:502: Request processed in 3527us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135634.966310:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789135634.966633:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8456:1876044545029504:0@lo:502: 00000040:00080000:2.0:1789135634.966677:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789135634.966885:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789135634.966909:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135634.966918:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135634.966939:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135634.966949:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789135634.966951:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789135634.966954:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789135634.966984:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135634.966991:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135634.967000:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135634.967019:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029632:0@lo:101: 00000100:00100000:0.0:1789135634.967131:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135634.967854:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0454f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135634.975376:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545029632 00000100:00100000:1.0:1789135634.975390:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545029632 00000100:00100000:1.0:1789135634.975450:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789135634.975459:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+13:5834:x1876044545029632:12345-0@lo:101: 00010000:00010000:1.0:1789135634.975476:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135634.975494:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34baa800/0x5b09da6ee1ce3f30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3f29 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.975518:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baa800/0x5b09da6ee1ce3f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f29 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.975529:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34baa800/0x5b09da6ee1ce3f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f29 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.975537:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34baa800, rc 0) 00000100:00100000:1.0:1789135634.975610:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545029632:12345-0@lo:101: Request processed in 151us (8479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135634.975617:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789135634.975685:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029632:0@lo:101: 00010000:00010000:1.0:1789135634.975703:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.975712:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135634.975795:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029760:0@lo:501: 00000100:00100000:1.0:1789135634.975826:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.975855:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135634.975869:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545029760 00000100:00100000:1.0:1789135634.975872:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545029760 00000100:00100000:1.0:1789135634.975893:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135634.975899:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545029760:12345-0@lo:501: 00000100:00100000:1.0:1789135634.976148:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545029760:12345-0@lo:501: Request processed in 248us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135634.976155:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135634.976188:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029760:0@lo:501: 00000100:00100000:1.0:1789135634.976216:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029888:0@lo:503: 00000100:00100000:1.0:1789135634.976253:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.976267:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135634.976278:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545029888 00000100:00100000:1.0:1789135634.976282:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545029888 00000100:00100000:1.0:1789135634.976302:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789135634.976307:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545029888:12345-0@lo:503: 00000100:00100000:1.0:1789135634.976443:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545029888:12345-0@lo:503: Request processed in 134us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135634.976450:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789135634.976489:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545029888:0@lo:503: 00000100:00100000:1.0:1789135634.976677:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8458:1876044545030016:0@lo:502: 00000100:00100000:1.0:1789135634.976709:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.976734:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545030016 00000100:00100000:1.0:1789135634.976737:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545030016 00000100:00100000:1.0:1789135634.976757:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789135634.976763:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:8458:x1876044545030016:12345-0@lo:502: 00000100:00100000:1.0:1789135634.976899:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:8458:x1876044545030016:12345-0@lo:502: Request processed in 134us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135634.976905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789135634.976936:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc392f1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135634.976948:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8458:1876044545030016:0@lo:502: 00000020:01000000:1.0:1789135634.976970:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135634.976978:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135634.976980:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789135634.976986:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789135634.977005:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8458:1876044545030144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135634.977035:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.977052:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545030144 00000100:00100000:1.0:1789135634.977056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545030144 00000100:00100000:1.0:1789135634.977099:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135634.977105:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:8458:x1876044545030144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135634.977209:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+14:8458:x1876044545030144:12345-0@lo:502:llog_process_th.0 Request processed in 103us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135634.977216:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135634.977245:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc392f1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135634.977257:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8458:1876044545030144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135634.977274:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135634.977279:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135634.977281:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789135634.977289:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789135634.977330:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789135634.977343:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789135634.977351:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.977360:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135634.977368:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789135634.977371:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc057f3800 from 39 10000000:01000000:1.0:1789135634.977373:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135634.977393:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.977400:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.977409:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135634.977421:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545030272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135634.977445:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.977458:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc392f1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135634.977470:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545030272 00000100:00100000:1.0:1789135634.977473:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545030272 00000100:00100000:1.0:1789135634.977492:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135634.977498:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:5834:x1876044545030272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135634.977506:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135634.977516:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34babe00/0x5b09da6ee1ce3f3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3f37 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.977540:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34babe00/0x5b09da6ee1ce3f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f37 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.977549:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34babe00/0x5b09da6ee1ce3f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f37 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.977557:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34babe00, rc 0) 00000100:00100000:1.0:1789135634.977585:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545030272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135634.977591:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135634.977621:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545030272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135634.977632:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135634.977640:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135634.977676:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545030400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135634.977700:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.977712:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc392f1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135634.977724:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545030400 00000100:00100000:1.0:1789135634.977726:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545030400 00000100:00100000:1.0:1789135634.977746:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789135634.977752:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545030400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135634.977935:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545030400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135634.977950:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789135634.977984:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545030400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135634.978024:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545030528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135634.978056:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135634.978090:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135634.978103:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545030528 00000100:00100000:1.0:1789135634.978106:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545030528 00000100:00100000:1.0:1789135634.978126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789135634.978131:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545030528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135634.988601:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545030528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10461us (10536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135634.988615:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789135634.991942:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545030528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135634.992221:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8459:1876044545030656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135634.992293:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135634.992329:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545030656 00000100:00100000:2.0:1789135634.992335:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545030656 00000100:00100000:2.0:1789135634.992374:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135634.992382:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:8459:x1876044545030656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135634.992612:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:8459:x1876044545030656:12345-0@lo:502:llog_process_th.0 Request processed in 230us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135634.992619:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135634.992664:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c84300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135634.992678:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8459:1876044545030656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135634.992715:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8459:1876044545030784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135634.992746:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135634.992759:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c84300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135634.992784:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545030784 00000100:00100000:2.0:1789135634.992787:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545030784 00000100:00100000:2.0:1789135634.992809:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135634.992815:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:8459:x1876044545030784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135634.992927:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+15:8459:x1876044545030784:12345-0@lo:502:llog_process_th.0 Request processed in 112us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135634.992934:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135634.992973:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8459:1876044545030784:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789135634.992991:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789135634.993039:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789135634.993057:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789135634.993089:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.993100:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135634.993108:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789135634.993110:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789135634.993113:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789135634.993134:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.993141:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.993150:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135634.993162:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545030912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135634.993188:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135634.993207:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c84300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135634.993218:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545030912 00000100:00100000:2.0:1789135634.993221:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545030912 00000100:00100000:2.0:1789135634.993242:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789135634.993249:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+15:5834:x1876044545030912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135634.993266:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135634.993276:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb2800/0x5b09da6ee1ce3f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3f45 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.993295:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb2800/0x5b09da6ee1ce3f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f45 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.993304:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb2800/0x5b09da6ee1ce3f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f45 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.993312:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2800, rc 0) 00000100:00100000:2.0:1789135634.993341:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545030912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135634.993347:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789135634.993373:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545030912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135634.993384:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135634.993393:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135634.993430:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135634.993454:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135634.993467:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c84300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135634.993478:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545031040 00000100:00100000:2.0:1789135634.993482:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545031040 00000100:00100000:2.0:1789135634.993502:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789135634.993508:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545031040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135634.993730:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545031040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135634.993736:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789135634.993780:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135634.993806:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135634.993839:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135634.993852:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c84300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135634.993863:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545031168 00000100:00100000:2.0:1789135634.993866:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545031168 00000100:00100000:2.0:1789135634.993883:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789135634.993888:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545031168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135634.994011:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545031168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135634.994018:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789135634.994049:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135635.001713:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8460:1876044545031296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135635.001797:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.001839:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0454fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135635.004508:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545031296 00000100:00100000:2.0:1789135635.004521:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545031296 00000100:00100000:2.0:1789135635.004578:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135635.004588:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:8460:x1876044545031296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135635.004849:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:8460:x1876044545031296:12345-0@lo:502:llog_process_th.0 Request processed in 262us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135635.004857:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135635.004921:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8460:1876044545031296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135635.004954:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135635.004967:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135635.004970:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789135635.004975:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789135635.005005:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8460:1876044545031424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135635.005084:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135635.005113:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135635.005126:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545031424 00000100:00100000:2.0:1789135635.005129:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545031424 00000100:00100000:2.0:1789135635.005155:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789135635.005161:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:8460:x1876044545031424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135635.005273:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:8460:x1876044545031424:12345-0@lo:502:llog_process_th.0 Request processed in 112us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135635.005280:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789135635.005318:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8460:1876044545031424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135635.005335:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135635.005339:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135635.005341:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789135635.005345:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789135635.006299:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789135635.006317:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789135635.006328:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.006339:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135635.006416:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789135635.006420:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc10b30000 from 39 10000000:01000000:2.0:1789135635.006423:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135635.006528:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.006538:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.006547:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135635.006564:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135635.006609:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135635.006638:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135635.006654:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545031552 00000100:00100000:2.0:1789135635.006658:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545031552 00000100:00100000:2.0:1789135635.006690:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789135635.006698:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545031552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135635.006709:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135635.006720:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb3600/0x5b09da6ee1ce3f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3f53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.006741:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb3600/0x5b09da6ee1ce3f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f53 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.006751:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb3600/0x5b09da6ee1ce3f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f53 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.006760:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3600, rc 0) 00000100:00100000:2.0:1789135635.006804:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545031552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135635.006811:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789135635.006857:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135635.006869:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.006878:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135635.006921:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135635.006946:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135635.006961:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135635.006989:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545031680 00000100:00100000:2.0:1789135635.006992:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545031680 00000100:00100000:2.0:1789135635.007014:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789135635.007020:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545031680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135635.008719:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545031680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1695us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135635.008728:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789135635.010985:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135635.011200:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135635.011277:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135635.011317:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135635.011341:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545031808 00000100:00100000:2.0:1789135635.012507:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545031808 00000100:00100000:2.0:1789135635.012564:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789135635.012572:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545031808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135635.012781:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545031808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135635.012797:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789135635.012860:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545031808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135635.024694:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342bbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8461:1876044545031936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135635.024790:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135635.024905:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc062349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135635.033430:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545031936 00000100:00100000:2.0:1789135635.033445:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545031936 00000100:00100000:2.0:1789135635.033559:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789135635.033570:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:8461:x1876044545031936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135635.033878:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:8461:x1876044545031936:12345-0@lo:502:llog_process_th.0 Request processed in 309us (9087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135635.033887:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135635.033986:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342bbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8461:1876044545031936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135635.034087:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342bbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8461:1876044545032064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135635.034146:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135635.042393:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc056383c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135635.044457:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545032064 00000100:00100000:0.0:1789135635.044471:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545032064 00000100:00100000:3.0:1789135635.044778:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789135635.044792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:8461:x1876044545032064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135635.045105:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:8461:x1876044545032064:12345-0@lo:502:llog_process_th.0 Request processed in 316us (10969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135635.045112:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789135635.046188:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342bbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8461:1876044545032064:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789135635.046232:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789135635.046516:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789135635.046538:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135635.046548:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135635.046574:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135635.046585:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789135635.046587:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789135635.046589:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789135635.046620:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135635.046628:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135635.046636:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135635.046657:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135635.046704:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.046743:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135635.046840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545032192 00000100:00100000:3.0:1789135635.046847:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545032192 00000100:00100000:3.0:1789135635.046875:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789135635.046882:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545032192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135635.046895:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135635.046906:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc029e5000/0x5b09da6ee1ce3f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3f61 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135635.046927:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc029e5000/0x5b09da6ee1ce3f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f61 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135635.046937:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc029e5000/0x5b09da6ee1ce3f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f61 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135635.046955:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e5000, rc 0) 00000100:00100000:3.0:1789135635.046989:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545032192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135635.046995:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789135635.048180:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135635.048199:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135635.048210:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135635.048269:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135635.048310:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.048464:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135635.048552:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545032320 00000100:00100000:3.0:1789135635.048558:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545032320 00000100:00100000:3.0:1789135635.048590:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789135635.048598:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545032320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135635.048840:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545032320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135635.048848:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789135635.048981:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135635.049012:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135635.049093:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.049110:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135635.049295:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545032448 00000100:00100000:3.0:1789135635.049300:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545032448 00000100:00100000:3.0:1789135635.049329:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789135635.049336:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545032448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135635.049593:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545032448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135635.049601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789135635.049896:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135635.052115:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8463:1876044545032576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135635.052315:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.052366:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeb900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135635.052582:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545032576 00000100:00100000:1.0:1789135635.052590:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545032576 00000100:00100000:1.0:1789135635.052707:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789135635.052717:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:8463:x1876044545032576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135635.053022:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:8463:x1876044545032576:12345-0@lo:502:llog_process_th.0 Request processed in 307us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135635.053031:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789135635.053185:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8463:1876044545032576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135635.053220:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135635.053235:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135635.053238:0:8463:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789135635.053244:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789135635.053272:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8463:1876044545032704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135635.053320:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135635.066018:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545032704 00000100:00100000:2.0:1789135635.066034:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545032704 00000100:00100000:2.0:1789135635.066121:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789135635.066132:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:8463:x1876044545032704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135635.067669:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:8463:x1876044545032704:12345-0@lo:502:llog_process_th.0 Request processed in 1534us (14343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135635.067681:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789135635.069705:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeb900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135635.069739:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8463:1876044545032704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135635.069793:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135635.069803:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135635.069805:0:8463:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789135635.069810:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789135635.069912:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789135635.069937:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789135635.069947:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.069959:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135635.069970:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789135635.069973:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adc06b64ed8 from 1 10000000:01000000:2.0:1789135635.069986:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789135635.070022:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.070030:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.070039:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135635.070059:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135635.070474:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135635.070547:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c84780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135635.072907:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545032832 00000100:00100000:3.0:1789135635.072920:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545032832 00000100:00100000:3.0:1789135635.072977:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789135635.072986:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545032832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135635.073001:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135635.073019:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc029e4400/0x5b09da6ee1ce3f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3f6f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135635.073077:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc029e4400/0x5b09da6ee1ce3f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f6f expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135635.073088:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc029e4400/0x5b09da6ee1ce3f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f6f expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135635.073097:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e4400, rc 0) 00000100:00100000:3.0:1789135635.073166:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545032832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135635.073172:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789135635.073482:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135635.073508:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135635.073530:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135635.073596:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135635.073631:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.073661:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeb900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135635.074200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545032960 00000100:00100000:1.0:1789135635.074207:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545032960 00000100:00100000:1.0:1789135635.074253:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789135635.074261:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545032960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135635.074837:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545032960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 575us (1203us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135635.074845:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789135635.074889:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545032960:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789135635.074924:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789135635.074932:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135635.074943:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135635.149709:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135635.470583:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545033472:0@lo:400:kworker.0 00000100:00100000:0.0:1789135635.470651:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.470712:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135635.470718:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545033344:0@lo:400:kworker.0 00000100:00100000:0.0:1789135635.470743:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.470784:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545033472 00000100:00100000:0.0:1789135635.470791:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545033472 00000100:00100000:0.0:1789135635.470849:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135635.470857:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545033472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135635.470905:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545033472:12345-0@lo:400:kworker.0 Request processed in 48us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135635.470913:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789135635.470934:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135635.470962:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7e1c0 x1876044545033472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135635.470975:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545033472:0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471089:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545033088:0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471125:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135635.471148:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545033600:0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135635.471184:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789135635.471190:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545033216:0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471209:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135635.471222:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545033728:0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471242:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135635.471264:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545033344 00000100:00100000:1.0:1789135635.471268:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545033344 00000100:00100000:1.0:1789135635.471295:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545033600 00000100:00100000:1.0:1789135635.471298:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545033600 00000100:00100000:1.0:1789135635.471309:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545033216 00000100:00100000:1.0:1789135635.471323:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545033216 00000100:00100000:1.0:1789135635.471346:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135635.471353:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545033344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471389:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545033344:12345-0@lo:400:kworker.0 Request processed in 36us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135635.471396:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135635.471418:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135635.471424:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471455:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545033600:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135635.471461:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135635.471475:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789135635.471481:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545033216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471507:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545033216:12345-0@lo:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135635.471513:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789135635.471544:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545033216:0@lo:400:kworker.0 00000100:00100000:1.0:1789135635.471553:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545033600:0@lo:400:kworker.0 00000100:00100000:0.0:1789135635.474633:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545033728 00000100:00100000:0.0:1789135635.474649:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545033728 00000100:00100000:0.0:1789135635.474743:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135635.474753:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545033728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135635.474870:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545033728:12345-0@lo:400:kworker.0 Request processed in 119us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135635.474879:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789135635.474903:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135635.474907:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135635.474942:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545033344:0@lo:400:kworker.0 00000100:00100000:0.0:1789135635.474973:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545033088 00000100:00100000:0.0:1789135635.474977:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545033088 00000100:00100000:0.0:1789135635.475001:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789135635.475007:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545033088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135635.475041:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545033088:12345-0@lo:400:kworker.0 Request processed in 34us (3915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135635.475048:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00080000:2.0:1789135635.475202:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7cf00 x1876044545033728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135635.475214:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545033728:0@lo:400:kworker.0 00000100:00100000:2.0:1789135635.475224:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545033088:0@lo:400:kworker.0 00000100:00100000:3.0:1789135635.981027:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545033856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135635.981122:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135635.981246:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545033856 00000100:00100000:0.0:1789135635.981254:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545033856 00000100:00100000:0.0:1789135635.981308:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135635.981319:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545033856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135635.981352:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135635.981417:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545033856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135635.981424:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789135635.981559:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7c000 x1876044545033856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135635.981595:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545033856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789135636.173846:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135636.408840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135636.408924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135636.409029:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512498048 00000100:00100000:0.0:1789135636.409042:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512498048 00000100:00100000:2.0:1789135636.409168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135636.409172:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 166 00000100:00100000:0.0:1789135636.409181:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+8:2376:x1876044512498048:12345-192.168.206.35@tcp:400: 00000100:00100000:2.0:1789135636.409191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135636.409208:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512498432 00000100:00100000:2.0:1789135636.409212:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512498432 00000100:00080000:0.0:1789135636.409248:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135636.409250:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512498304 00000100:00100000:2.0:1789135636.409252:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512498304 00000100:00100000:0.0:1789135636.409272:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+8:2376:x1876044512498048:12345-192.168.206.35@tcp:400: Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135636.409280:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 166 00000100:00100000:2.0:1789135636.409290:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1789135636.409300:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41953840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512498432:12345-192.168.206.35@tcp:400: 00000100:00100000:2.0:1789135636.409327:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41953840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512498432:12345-192.168.206.35@tcp:400: Request processed in 31us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135636.409333:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1789135636.409352:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:2.0:1789135636.409358:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512498304:12345-192.168.206.35@tcp:400: 00000100:00100000:2.0:1789135636.409384:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512498304:12345-192.168.206.35@tcp:400: Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135636.409390:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00080000:0.0:1789135636.409394:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135636.409478:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512498176 00000100:00100000:1.0:1789135636.409483:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512498176 00000100:00100000:1.0:1789135636.409532:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:1.0:1789135636.409540:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512498176:12345-192.168.206.35@tcp:400: 00000100:00100000:1.0:1789135636.409582:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512498176:12345-192.168.206.35@tcp:400: Request processed in 43us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135636.409588:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00080000:0.0:1789135636.410153:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135637.004628:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135637.004666:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545033984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135637.004917:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135637.005089:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545033984 00000100:00100000:0.0:1789135637.005097:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545033984 00000100:00100000:0.0:1789135637.005178:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789135637.005188:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41951e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545033984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135637.005223:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135637.005269:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41951e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545033984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135637.005276:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789135637.005437:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135637.005466:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7e1c0 x1876044545033984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135637.005499:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545033984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135637.196361:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135638.220320:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135639.244310:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135640.268296:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135640.588645:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc419512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545034240:0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.588694:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41950780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545034368:0@lo:400:kworker.0 00000100:00100000:3.0:1789135640.588714:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135640.588761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135640.588788:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545034752:0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.588802:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135640.588810:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545034496:0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.588837:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135640.588875:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545034240 00000100:00100000:3.0:1789135640.588880:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135640.588883:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545034240 00000100:00100000:2.0:1789135640.588928:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545034368 00000100:00100000:2.0:1789135640.588931:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545034368 00000100:00100000:2.0:1789135640.588961:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135640.588971:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545034240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135640.589024:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789135640.589035:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc419530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545034112:0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.589037:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545034240:12345-0@lo:400:kworker.0 Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135640.589046:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135640.589083:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135640.589093:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545034368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135640.589110:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135640.589137:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545034368:12345-0@lo:400:kworker.0 Request processed in 46us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135640.589141:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545034624:0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.589148:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789135640.589172:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135640.589173:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135640.589187:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545034496 00000100:00100000:2.0:1789135640.589192:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545034496 00000100:00100000:3.0:1789135640.589212:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc419512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545034240:0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.589223:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545034752 00000100:00100000:2.0:1789135640.589227:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545034752 00000100:00100000:3.0:1789135640.589247:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545034112 00000100:00100000:3.0:1789135640.589253:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545034112 00000100:00100000:2.0:1789135640.589266:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135640.589276:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41951680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545034496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135640.589285:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789135640.589303:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545034112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.589315:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41951680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545034496:12345-0@lo:400:kworker.0 Request processed in 41us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135640.589322:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135640.589337:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789135640.589345:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a355a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545034752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135640.589351:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545034112:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135640.589360:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789135640.589381:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a355a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545034752:12345-0@lo:400:kworker.0 Request processed in 37us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135640.589387:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789135640.589406:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc419530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545034112:0@lo:400:kworker.0 00000100:00080000:2.0:1789135640.589409:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135640.589414:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135640.589422:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41953480 x1876044545034752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135640.589434:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545034752:0@lo:400:kworker.0 00010000:00080000:3.0:1789135640.589476:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41952d00 x1876044545034496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135640.589483:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545034624 00000100:00100000:3.0:1789135640.589486:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545034496:0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.589489:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545034624 00000100:00100000:3.0:1789135640.589503:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41950780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545034368:0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.589525:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789135640.589534:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135640.589535:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545034624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135640.589589:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545034624:12345-0@lo:400:kworker.0 Request processed in 56us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135640.589596:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135640.589625:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545034624:0@lo:400:kworker.0 00000100:00100000:3.0:1789135641.016910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135641.017023:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512498560 00000100:00100000:0.0:1789135641.017032:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512498560 00000100:00100000:0.0:1789135641.017110:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 168 00000100:00100000:0.0:1789135641.017120:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+8:5620:x1876044512498560:12345-192.168.206.35@tcp:101: 00010000:00010000:0.0:1789135641.017135:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135641.017152:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3f7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3485 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135641.017178:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3485 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135641.017189:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3485 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135641.017215:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031a00, rc 0) 00000100:00100000:0.0:1789135641.017286:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5620:x1876044512498560:12345-192.168.206.35@tcp:101: Request processed in 168us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135641.017293:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 168 00000100:00100000:2.0:1789135641.030952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135641.031039:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512498688 00000100:00100000:0.0:1789135641.031048:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512498688 00000100:00100000:0.0:1789135641.031140:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 169 00000100:00100000:0.0:1789135641.031150:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5620:x1876044512498688:12345-192.168.206.35@tcp:501: 00000100:00100000:0.0:1789135641.031429:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5620:x1876044512498688:12345-192.168.206.35@tcp:501: Request processed in 279us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135641.031437:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 169 00000100:00100000:1.0:1789135641.034383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135641.035157:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512498816 00000100:00100000:3.0:1789135641.035168:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512498816 00000100:00100000:3.0:1789135641.035228:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 170 00000100:00100000:3.0:1789135641.035238:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5620:x1876044512498816:12345-192.168.206.35@tcp:503: 00000100:00100000:3.0:1789135641.035577:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5620:x1876044512498816:12345-192.168.206.35@tcp:503: Request processed in 339us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135641.035586:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 170 00000100:00100000:2.0:1789135641.052456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135641.052619:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512498944 00000100:00100000:3.0:1789135641.052641:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512498944 00000100:00100000:3.0:1789135641.052698:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 171 00000100:00100000:3.0:1789135641.052708:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+9:6126:x1876044512498944:12345-192.168.206.35@tcp:502: 00000100:00100000:3.0:1789135641.053036:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+9:6126:x1876044512498944:12345-192.168.206.35@tcp:502: Request processed in 328us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135641.053044:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 171 00000100:00100000:2.0:1789135641.058190:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135641.058292:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512499072 00000100:00100000:0.0:1789135641.058302:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512499072 00000100:00100000:0.0:1789135641.058367:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 172 00000100:00100000:0.0:1789135641.058375:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+9:6126:x1876044512499072:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135641.058639:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+9:6126:x1876044512499072:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 263us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135641.058647:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 172 00000100:00100000:1.0:1789135641.064478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135641.065590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512499200 00000100:00100000:0.0:1789135641.065601:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512499200 00000100:00100000:0.0:1789135641.065667:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 173 00000100:00100000:0.0:1789135641.065676:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5620:x1876044512499200:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135641.065692:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135641.065708:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00030400/0x5b09da6ee1ce3f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d348c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135641.065769:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030400/0x5b09da6ee1ce3f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d348c expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135641.065797:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00030400/0x5b09da6ee1ce3f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d348c expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135641.065806:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030400, rc 0) 00000100:00100000:0.0:1789135641.065887:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5620:x1876044512499200:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 202us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135641.065894:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 173 00000100:00100000:3.0:1789135641.070568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135641.070794:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512499328 00000100:00100000:0.0:1789135641.070803:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512499328 00000100:00100000:0.0:1789135641.071225:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 174 00000100:00100000:0.0:1789135641.071235:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5620:x1876044512499328:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135641.071587:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5620:x1876044512499328:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 353us (1027us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135641.071596:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 174 00000100:00100000:3.0:1789135641.100261:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545034880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135641.100330:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135641.100613:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545034880 00000100:00100000:0.0:1789135641.100621:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545034880 00000100:00100000:0.0:1789135641.101250:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135641.101263:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545034880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135641.101307:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135641.101371:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545034880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135641.101379:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789135641.101409:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7ed00 x1876044545034880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135641.101430:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545034880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135641.293686:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135641.542458:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135641.542496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135641.542525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135641.542565:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512499456 00000100:00100000:0.0:1789135641.542574:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512499456 00000100:00100000:0.0:1789135641.542640:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1789135641.542650:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512499456:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135641.542720:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512499456:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135641.542727:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00080000:0.0:1789135641.542778:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135641.543302:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512499584 00000100:00100000:2.0:1789135641.543309:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512499584 00000100:00100000:2.0:1789135641.543352:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512499712 00000100:00100000:2.0:1789135641.543355:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512499712 00000100:00100000:2.0:1789135641.543377:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1789135641.543386:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512499584:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135641.543435:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512499584:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 51us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135641.543443:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1789135641.543456:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:2.0:1789135641.543463:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512499712:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135641.543485:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512499712:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 24us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135641.543491:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00080000:2.0:1789135641.543571:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135641.543574:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789135642.052513:0:8501:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4bf2cb70 20000000:00000080:0.0:1789135642.052536:0:8501:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc07a54000 uarg=0000000000000000 20000000:01000000:0.0:1789135642.052583:0:8501:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789135642.052589:0:8501:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789135642.052593:0:8501:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789135642.054360:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789135642.055186:0:8501:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789135642.063374:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789135642.063419:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789135642.063463:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789135642.063479:0:8501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789135642.063495:0:8501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063510:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3d54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063516:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063523:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063530:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063536:0:8501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063578:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063591:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 9 pid: 5831 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135642.063610:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1876044545035008:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135642.063702:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063710:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 18 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135642.063717:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342ba1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1876044545035136:0@lo:104: 00000100:00100000:1.0:1789135642.063764:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135642.063796:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.063803:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 18 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135642.063811:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1876044545035264:0@lo:104: 00000100:00100000:3.0:1789135642.063856:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545035136 00000100:00100000:3.0:1789135642.063864:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545035136 00000100:00100000:3.0:1789135642.063921:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135642.063932:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+3:8501:x1876044545035136:12345-0@lo:104: 00010000:00010000:3.0:1789135642.063944:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135642.064468:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135642.064500:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.064511:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 18 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135642.064521:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1876044545035392:0@lo:104: 00000100:00100000:1.0:1789135642.064655:0:8501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91840 going to sleep for 11 seconds 00010000:00010000:3.0:1789135642.067507:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135642.067520:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+3:8501:x1876044545035136:12345-0@lo:104: Request processed in 3587us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135642.067532:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135642.067570:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789135642.067591:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135642.067616:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545035264 00000100:00100000:3.0:1789135642.067637:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545035264 00000100:00100000:3.0:1789135642.067664:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545035392 00000100:00100000:3.0:1789135642.067667:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545035392 00000100:00100000:3.0:1789135642.067680:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135642.067688:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a353050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+4:8501:x1876044545035264:12345-0@lo:104: 00010000:00010000:3.0:1789135642.067702:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.067765:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789135642.067771:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a353050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+4:8501:x1876044545035264:12345-0@lo:104: Request processed in 84us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135642.067778:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135642.067812:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789135642.067818:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+3:8501:x1876044545035392:12345-0@lo:104: 00010000:00010000:3.0:1789135642.067825:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068130:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789135642.068137:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:45dd8677-45c4-4169-a65f-287162436408+3:8501:x1876044545035392:12345-0@lo:104: Request processed in 320us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135642.068245:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789135642.068268:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789135642.068283:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068291:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2a00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135642.068296:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068469:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135642.068477:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135642.068482:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135642.068517:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068523:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135642.068540:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068547:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2a00/0x5b09da6ee1ce3e26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3e2d expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068558:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135642.068562:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068567:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135642.068570:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068577:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135642.068584:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135642.068596:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135642.068703:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068710:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135642.068734:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068742:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc01480e00/0x5b09da6ee1ce3dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3dd2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068753:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135642.068756:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068762:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc029e4200 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135642.068765:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068772:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135642.068779:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135642.068784:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789135642.068791:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342ba1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1876044545035136:0@lo:104: 00010000:00010000:3.0:1789135642.068799:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135642.068804:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1876044545035264:0@lo:104: 00010000:00010000:3.0:1789135642.068808:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789135642.068824:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1876044545035392:0@lo:104: 00010000:00010000:3.0:1789135642.068825:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068835:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc029e4200/0x5b09da6ee1ce3d4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3d54 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.068852:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135642.068854:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135642.068856:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135642.068870:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135642.068883:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545035520:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135642.069151:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135642.069734:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135642.069789:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545035648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135642.069851:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545035520 00000100:00100000:2.0:1789135642.069857:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545035520 00010000:00010000:2.0:1789135642.069889:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135642.070050:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789135642.070083:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545035520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135642.070097:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135642.070102:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.070111:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.070125:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce3e2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3e26 expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.070571:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135642.070706:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135642.070755:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135642.070762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135642.070764:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a355e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545035776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135642.070797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135642.070805:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1876044545035008:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135642.070831:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545035648 00000100:00100000:3.0:1789135642.070835:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545035648 00010000:00010000:3.0:1789135642.070853:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135642.070867:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512499840 00000100:00100000:3.0:1789135642.070869:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512499840 00010000:00010000:3.0:1789135642.070883:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 10 pid: 5831 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135642.070896:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545035776 00000100:00100000:3.0:1789135642.070899:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545035776 00010000:00010000:3.0:1789135642.070910:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 20 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.070916:0:8501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135642.071087:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+20:3315:x1876044545035520:12345-0@lo:103:ldlm_bl.0 Request processed in 1029us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135642.071095:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789135642.071111:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135642.071119:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545035648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135642.071127:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135642.071132:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135642.074881:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:3.0:1789135642.074898:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512499840:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135642.075088:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135642.075098:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 10 pid: 5831 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.075174:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135642.075245:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135642.075268:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135642.075275:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545035520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135642.075282:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545035776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135642.075293:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135642.075300:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.075342:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 10 pid: 5831 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.075555:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2200/0x5b09da6ee1ce3eea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3454 expref: 10 pid: 5831 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135642.075571:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135642.075625:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+9:2375:x1876044512499840:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 735us (4865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135642.075632:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00010000:00010000:2.0:1789135642.080331:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01480800/0x5b09da6ee1ce3dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3dcb expref: 19 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.080352:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135642.080490:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+18:3313:x1876044545035648:12345-0@lo:103:ldlm_bl.0 Request processed in 9371us (9783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135642.080500:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789135642.084503:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 17 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135642.084530:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3d54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3d4d expref: 17 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135642.084565:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135642.084574:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.084833:0:8444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.084845:0:8444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.084853:0:8444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.084860:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.084866:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baac00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135642.084870:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.084878:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.084901:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135642.084922:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135642.085007:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45dd8677-45c4-4169-a65f-287162436408+16:3313:x1876044545035776:12345-0@lo:103:ldlm_bl.0 Request processed in 9730us (14208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135642.085018:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789135642.085788:0:8501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.085799:0:8501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.085806:0:8501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce3f8b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135642.088862:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545035648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135642.088890:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a355e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545035776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135642.125404:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135642.125428:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545035904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135642.125499:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135642.130303:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545035904 00000100:00100000:0.0:1789135642.130320:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545035904 00000100:00100000:0.0:1789135642.130405:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135642.130416:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545035904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135642.130451:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135642.130527:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545035904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135642.130535:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789135642.144609:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135642.144659:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41952580 x1876044545035904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135642.146185:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545035904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135642.316836:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135642.466608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135642.466904:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512499968 00000100:00100000:2.0:1789135642.466913:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512499968 00000100:00100000:2.0:1789135642.466965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 175 00000100:00100000:2.0:1789135642.466975:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+9:5620:x1876044512499968:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135642.466991:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135642.467019:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3493 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.467044:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.467054:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135642.467291:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3a00, rc 0) 00000100:00100000:2.0:1789135642.467407:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5620:x1876044512499968:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 433us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135642.467415:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 175 00000100:00100000:3.0:1789135642.474249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135642.474324:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512500096 00000100:00100000:1.0:1789135642.474333:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512500096 00000100:00100000:0.0:1789135642.474938:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 176 00000100:00100000:0.0:1789135642.474953:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5620:x1876044512500096:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135642.475293:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5620:x1876044512500096:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 344us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135642.475301:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 176 00000100:00100000:1.0:1789135642.482194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135642.482283:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512500224 00000100:00100000:2.0:1789135642.482306:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512500224 00000100:00100000:2.0:1789135642.482364:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 177 00000100:00100000:2.0:1789135642.482375:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5620:x1876044512500224:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135642.482620:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:5620:x1876044512500224:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 246us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135642.482628:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 177 00000100:00100000:3.0:1789135642.487414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135642.487608:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512500352 00000100:00100000:2.0:1789135642.487616:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512500352 00000100:00100000:2.0:1789135642.487774:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 178 00000100:00100000:2.0:1789135642.487784:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:6183:x1876044512500352:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135642.488000:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:6183:x1876044512500352:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 217us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135642.488009:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 178 00000100:00100000:2.0:1789135642.489599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135642.489785:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512500480 00000100:00100000:0.0:1789135642.489795:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512500480 00000100:00100000:0.0:1789135642.489871:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 179 00000100:00100000:0.0:1789135642.489881:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:6183:x1876044512500480:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135642.490122:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:6183:x1876044512500480:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 242us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135642.490138:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 179 10000000:01000000:3.0:1789135643.212447:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135643.212453:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adb01c80000 from 4 10000000:01000000:3.0:1789135643.212458:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135643.212498:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135643.212514:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135643.212526:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135643.213290:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135643.213417:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135643.213467:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135643.213503:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545036032 00000100:00100000:3.0:1789135643.213509:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545036032 00000100:00100000:3.0:1789135643.214099:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789135643.214108:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545036032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135643.214124:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135643.214149:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3f99 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135643.214753:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135643.214766:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135643.214777:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e4200, rc 0) 00000100:00100000:3.0:1789135643.215004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545036032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 897us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135643.215012:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789135643.215271:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135643.215288:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135643.215298:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135643.215357:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135643.215401:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135643.215427:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135643.215442:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545036160 00000100:00100000:0.0:1789135643.215447:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545036160 00000100:00100000:0.0:1789135643.215474:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789135643.215482:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545036160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135643.215697:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545036160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135643.215704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789135643.215750:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135643.215774:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135643.215817:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135643.215829:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135643.215839:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545036288 00000100:00100000:0.0:1789135643.215842:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545036288 00000100:00100000:0.0:1789135643.215859:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789135643.215870:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545036288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135643.215998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545036288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135643.216005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789135643.216038:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135643.217052:0:8569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8569:1876044545036416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135643.218686:0:8569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135643.218737:0:8569:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c21780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135643.218754:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545036416 00000100:00100000:2.0:1789135643.218761:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545036416 00000100:00100000:2.0:1789135643.218849:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789135643.218859:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:8569:x1876044545036416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135643.219223:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:8569:x1876044545036416:12345-0@lo:502:llog_process_th.0 Request processed in 365us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135643.219231:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789135643.219236:0:8569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8569:1876044545036416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135643.219263:0:8569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135643.219271:0:8569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135643.219273:0:8569:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789135643.219280:0:8569:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adb01c80000 00000020:00000080:3.0:1789135643.219283:0:8569:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135643.219355:0:8569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a356d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8569:1876044545036544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135643.219388:0:8569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135643.226741:0:8569:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135643.231647:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545036544 00000100:00100000:0.0:1789135643.231662:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545036544 00000100:00100000:1.0:1789135643.231859:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789135643.231868:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:8569:x1876044545036544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135643.233360:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:8569:x1876044545036544:12345-0@lo:502:llog_process_th.0 Request processed in 1488us (13967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135643.233372:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789135643.233429:0:8569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a356d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8569:1876044545036544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135643.233462:0:8569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135643.233470:0:8569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135643.233473:0:8569:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789135643.233480:0:8569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789135643.233631:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789135643.233647:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135643.233656:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135643.233667:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135643.233677:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135643.233679:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc057f3800 from 4 10000000:01000000:1.0:1789135643.233682:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135643.233709:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135643.233717:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135643.233737:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135643.233768:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135643.233800:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135643.233832:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d20600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135643.233925:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545036672 00000100:00100000:3.0:1789135643.233931:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545036672 00000100:00100000:3.0:1789135643.233982:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789135643.233991:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545036672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135643.234003:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135643.234014:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3fa7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135643.234034:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135643.234053:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135643.234513:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e5800, rc 0) 00000100:00100000:3.0:1789135643.234566:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545036672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 577us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135643.234573:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789135643.234811:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135643.234825:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135643.234836:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135643.234883:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135643.234908:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135643.234931:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d20600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135643.235017:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545036800 00000100:00100000:2.0:1789135643.235022:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545036800 00000100:00100000:2.0:1789135643.235078:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789135643.235087:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545036800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135643.235329:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545036800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135643.235342:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789135643.235347:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135643.235397:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a356d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135643.235431:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135643.235460:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135643.235468:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545036928 00000100:00100000:1.0:1789135643.235472:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545036928 00000100:00100000:1.0:1789135643.235503:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789135643.235509:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545036928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135643.235715:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545036928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135643.235732:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789135643.235807:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a356d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545036928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135643.236614:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a356d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8572:1876044545037056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135643.236655:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135643.236679:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135643.236751:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545037056 00000100:00100000:2.0:1789135643.236757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545037056 00000100:00100000:2.0:1789135643.236795:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789135643.236802:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:8572:x1876044545037056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135643.237161:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:8572:x1876044545037056:12345-0@lo:502:llog_process_th.0 Request processed in 358us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135643.237168:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789135643.238225:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a356d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8572:1876044545037056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135643.238256:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135643.238265:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135643.238267:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135643.238272:0:8572:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc057f3800 00000020:00000080:2.0:1789135643.238275:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135643.238464:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8572:1876044545037184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135643.238510:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135643.238538:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc056389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135643.239053:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545037184 00000100:00100000:1.0:1789135643.239059:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545037184 00000100:00100000:1.0:1789135643.239115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789135643.239123:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:8572:x1876044545037184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135643.239317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:8572:x1876044545037184:12345-0@lo:502:llog_process_th.0 Request processed in 194us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135643.239329:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789135643.239353:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8572:1876044545037184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135643.239373:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135643.239387:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135643.239389:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789135643.239393:0:8572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789135643.241052:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789135643.241105:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135643.241117:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135643.241129:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135643.241141:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135643.241143:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc10b30000 from 4 10000000:01000000:1.0:1789135643.241146:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135643.241192:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135643.241201:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135643.241211:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135643.241232:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545037312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135643.241286:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135643.241330:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135643.241335:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545037312 00000100:00100000:2.0:1789135643.241341:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545037312 00000100:00100000:2.0:1789135643.241395:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789135643.241404:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545037312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135643.241424:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135643.241437:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3fb5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135643.241460:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135643.241470:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135643.241478:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2600, rc 0) 00000100:00100000:2.0:1789135643.241515:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545037312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135643.241522:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789135643.241554:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545037312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135643.241565:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135643.241574:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135643.241620:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545037440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135643.241643:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135643.241657:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc056389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135643.241668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545037440 00000100:00100000:2.0:1789135643.241671:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545037440 00000100:00100000:2.0:1789135643.241687:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789135643.241693:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545037440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135643.242243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545037440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 548us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135643.242251:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789135643.242286:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545037440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135643.242469:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545037568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135643.242507:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135643.242537:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc056389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135643.242555:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545037568 00000100:00100000:2.0:1789135643.242559:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545037568 00000100:00100000:2.0:1789135643.242584:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789135643.242591:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545037568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135643.243123:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545037568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135643.243132:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789135643.243178:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545037568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135643.243620:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8573:1876044545037696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135643.243660:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135643.243689:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc136259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135643.243751:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545037696 00000100:00100000:0.0:1789135643.243756:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545037696 00000100:00100000:0.0:1789135643.243790:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789135643.243797:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:8573:x1876044545037696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135643.243956:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:8573:x1876044545037696:12345-0@lo:502:llog_process_th.0 Request processed in 158us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135643.243963:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789135643.244003:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8573:1876044545037696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135643.244026:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135643.244034:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135643.244037:0:8573:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135643.244054:0:8573:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc10b30000 00000020:00000080:2.0:1789135643.244056:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135643.244148:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8573:1876044545037824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135643.244181:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135643.244208:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05527240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135643.244249:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545037824 00000100:00100000:0.0:1789135643.244254:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545037824 00000100:00100000:0.0:1789135643.244283:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789135643.244290:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:8573:x1876044545037824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135643.244396:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:8573:x1876044545037824:12345-0@lo:502:llog_process_th.0 Request processed in 106us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135643.244402:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789135643.244516:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41952580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:8573:1876044545037824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135643.244534:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135643.244538:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135643.244540:0:8573:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789135643.244543:0:8573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789135643.244752:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789135643.244771:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135643.244786:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135643.244797:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135643.342407:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135644.367630:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135645.388417:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135645.710059:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545038336:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710154:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135645.710208:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789135645.710216:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545037952:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710246:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135645.710269:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545038464:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710295:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135645.710320:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545038080:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710345:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135645.710363:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545038592:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135645.710404:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135645.710409:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545038208:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710431:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135645.710475:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545038336 00000100:00100000:0.0:1789135645.710482:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545038336 00000100:00100000:0.0:1789135645.710531:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545038592 00000100:00100000:0.0:1789135645.710535:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545038592 00000100:00100000:0.0:1789135645.710562:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135645.710571:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545038336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710632:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545038336:12345-0@lo:400:kworker.0 Request processed in 62us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135645.710640:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135645.710657:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789135645.710664:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545038592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710695:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545038592:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135645.710702:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789135645.710731:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545037952 00000100:00100000:0.0:1789135645.710735:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545037952 00000100:00100000:0.0:1789135645.710759:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789135645.710765:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545037952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.710794:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545037952:12345-0@lo:400:kworker.0 Request processed in 30us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135645.712879:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789135645.713196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545038464 00000100:00100000:0.0:1789135645.713204:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545038464 00000100:00100000:0.0:1789135645.713293:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545038080 00000100:00100000:0.0:1789135645.713297:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545038080 00000100:00080000:1.0:1789135645.717494:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135645.717505:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135645.717507:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135645.721403:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545038208 00000100:00100000:2.0:1789135645.721415:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545038208 00000100:00100000:2.0:1789135645.721487:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789135645.721497:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545038464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135645.721577:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545038464:12345-0@lo:400:kworker.0 Request processed in 82us (11281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135645.721584:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789135645.721600:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789135645.721607:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545038080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135645.721638:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545038080:12345-0@lo:400:kworker.0 Request processed in 32us (11292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135645.721644:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789135645.721655:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789135645.721661:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1857d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545038208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135645.721688:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1857d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545038208:12345-0@lo:400:kworker.0 Request processed in 28us (11256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135645.721694:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789135645.721727:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135645.723838:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545038208:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.723855:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545038080:0@lo:400:kworker.0 00010000:00080000:0.0:1789135645.723868:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7f480 x1876044545038592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135645.723878:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545038592:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.723933:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545037952:0@lo:400:kworker.0 00000100:00100000:0.0:1789135645.723965:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545038464:0@lo:400:kworker.0 00010000:00080000:0.0:1789135645.723987:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7d680 x1876044545038336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135645.723996:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545038336:0@lo:400:kworker.0 00000100:00100000:2.0:1789135646.228494:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135646.228515:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc419521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545038720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135646.228576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135646.228637:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545038720 00000100:00100000:2.0:1789135646.228644:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545038720 00000100:00100000:2.0:1789135646.228700:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789135646.228722:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545038720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135646.228750:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135646.228792:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545038720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135646.228799:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789135646.228842:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc419521c0 x1876044545038720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135646.228859:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc419521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545038720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135646.412373:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135646.647051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135646.647111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135646.647149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135646.647172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135646.647200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512500608 00000100:00100000:1.0:1789135646.647209:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512500608 00000100:00100000:1.0:1789135646.647259:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 196 00000100:00100000:1.0:1789135646.647268:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512500608:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135646.647334:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512500608:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 67us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135646.647341:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 196 00000100:00100000:1.0:1789135646.647384:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512500864 00000100:00100000:1.0:1789135646.647388:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512500864 00000100:00100000:1.0:1789135646.647419:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512500992 00000100:00100000:1.0:1789135646.647421:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512500992 00000100:00100000:1.0:1789135646.647438:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:1.0:1789135646.647444:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512500864:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135646.647471:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512500864:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135646.647477:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:1.0:1789135646.647491:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1789135646.647497:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512500992:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135646.647520:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512500992:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 24us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135646.647527:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00080000:3.0:1789135646.648363:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135646.648368:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135646.648676:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512500736 00000100:00100000:1.0:1789135646.648685:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512500736 00000100:00100000:1.0:1789135646.648787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:1.0:1789135646.648816:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512500736:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135646.648858:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512500736:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 45us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135646.648866:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00080000:3.0:1789135646.658778:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135647.246129:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135647.246151:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc419521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545038848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135647.246212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135647.246277:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545038848 00000100:00100000:2.0:1789135647.246292:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545038848 00000100:00100000:2.0:1789135647.246344:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789135647.246357:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545038848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135647.246390:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135647.246431:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545038848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135647.246439:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789135647.246459:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135647.246485:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc419521c0 x1876044545038848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135647.246514:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc419521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545038848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135647.436726:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135648.460483:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789135648.623915:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789135649.485663:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135650.509748:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135650.840767:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135650.840789:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545038976:0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.840858:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135650.840927:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135650.841080:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545038976 00000100:00100000:3.0:1789135650.841087:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545038976 00000100:00100000:3.0:1789135650.841124:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789135650.841132:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545038976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135650.841177:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545038976:12345-0@lo:400:kworker.0 Request processed in 46us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135650.841185:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789135650.841226:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545038976:0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.841373:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545039104:0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.841402:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135650.841438:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545039232:0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.841456:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135650.841478:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545039104 00000100:00100000:1.0:1789135650.841482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545039104 00000100:00100000:1.0:1789135650.841501:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545039232 00000100:00100000:1.0:1789135650.841503:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545039232 00000100:00100000:1.0:1789135650.841523:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789135650.841528:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545039104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.841562:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545039104:12345-0@lo:400:kworker.0 Request processed in 33us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135650.841568:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789135650.841591:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789135650.841598:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545039232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.841625:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545039232:12345-0@lo:400:kworker.0 Request processed in 28us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135650.841642:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789135650.841691:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545039232:0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.841703:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545039104:0@lo:400:kworker.0 00000100:00080000:2.0:1789135650.841856:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135650.845467:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135650.845487:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545039616:0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.845588:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135650.845638:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545039616 00000100:00100000:1.0:1789135650.845645:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545039616 00000100:00100000:1.0:1789135650.845706:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789135650.845715:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545039616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.845773:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545039616:12345-0@lo:400:kworker.0 Request processed in 59us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135650.845781:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789135650.845829:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fb840 x1876044545039616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135650.845843:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545039616:0@lo:400:kworker.0 00000100:00100000:3.0:1789135650.845968:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545039488:0@lo:400:kworker.0 00000100:00100000:3.0:1789135650.846001:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135650.846026:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135650.846049:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545039360:0@lo:400:kworker.0 00000100:00100000:3.0:1789135650.846089:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135650.846116:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545039360 00000100:00100000:3.0:1789135650.846121:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545039360 00000100:00100000:3.0:1789135650.846154:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789135650.846161:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a356580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545039360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135650.846200:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a356580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545039360:12345-0@lo:400:kworker.0 Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135650.846206:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789135650.846237:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057f9a40 x1876044545039360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135650.846247:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545039360:0@lo:400:kworker.0 00000100:00080000:2.0:1789135650.846941:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135650.846946:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135650.847761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545039488 00000100:00100000:1.0:1789135650.847769:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545039488 00000100:00100000:1.0:1789135650.847825:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789135650.847833:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545039488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135650.847891:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545039488:12345-0@lo:400:kworker.0 Request processed in 58us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135650.847898:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135650.849659:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545039488:0@lo:400:kworker.0 00000100:00080000:2.0:1789135650.850730:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135651.340487:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135651.340516:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545039744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135651.340579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135651.340635:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545039744 00000100:00100000:1.0:1789135651.340642:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545039744 00000100:00100000:1.0:1789135651.340697:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135651.340706:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545039744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135651.340753:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135651.340852:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545039744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135651.340860:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789135651.340918:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fb840 x1876044545039744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135651.341055:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545039744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789135651.539418:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135651.767559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135651.767623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135651.767780:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512501248 00000100:00100000:2.0:1789135651.767789:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512501248 00000100:00100000:2.0:1789135651.767858:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:2.0:1789135651.767872:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512501248:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135651.767945:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512501248:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135651.767953:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:1.0:1789135651.768634:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512501120 00000100:00100000:1.0:1789135651.768639:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512501120 00000100:00100000:1.0:1789135651.768689:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 198 00000100:00100000:1.0:1789135651.768697:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512501120:12345-192.168.206.35@tcp:400:kworker.0 00000100:00080000:3.0:1789135651.768792:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135651.768832:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512501120:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 135us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135651.768839:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 198 00000100:00100000:3.0:1789135651.773368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135651.773395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135651.773517:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512501376 00000100:00100000:2.0:1789135651.773526:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512501376 00000100:00100000:2.0:1789135651.773582:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512501504 00000100:00100000:2.0:1789135651.773586:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512501504 00000100:00100000:2.0:1789135651.773610:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1789135651.773669:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a355e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2374:x1876044512501376:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:2.0:1789135651.773713:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3ef8 00000100:00080000:2.0:1789135651.773722:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8adc41d63800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789135651.773754:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789135651.774152:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a355e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+2:2374:x1876044512501376:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 443us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135651.782448:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1789135651.782474:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2374:x1876044512501504:12345-192.168.206.35@tcp:9:kworker.0 00000100:00080000:3.0:1789135651.783584:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135651.783591:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789135651.783737:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135651.787390:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000020:00000080:1.0:1789135651.792014:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3eff 00000100:00080000:1.0:1789135651.792040:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8adc41d61800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789135651.792103:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789135651.792111:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789135651.792460:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a357840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+2:2374:x1876044512501504:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 9995us (19058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135651.792471:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1789135652.366788:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545039872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135652.366851:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135652.367096:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545039872 00000100:00100000:2.0:1789135652.367110:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545039872 00000100:00100000:2.0:1789135652.367352:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135652.367366:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545039872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135652.367397:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135652.367460:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545039872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135652.367468:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789135652.367491:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135652.367623:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fb840 x1876044545039872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135652.367643:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545039872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135652.556701:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135653.589377:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789135654.505739:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:2.0:1789135654.505747:0:7637:0:(genops.c:885:class_export_put()) final put ffff8adc41d64000/5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:3.0:1789135654.506171:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41d64000/5f7ef768-1508-4eda-9824-c10078b0a61e for lustre-OST0001 00000020:00000080:3.0:1789135654.506220:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc41d61800 for lustre-OST0001 00010000:00010000:0.0:1789135654.615703:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135654.964612:0:9047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing yml_node 00010000:00010000:0.0:1789135655.631184:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135655.950360:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545040384:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.950427:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135655.950490:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135655.950497:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545040000:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.950526:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135655.950551:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545040512:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.950575:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135655.950598:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545040256:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.950639:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135655.950667:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789135655.950673:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545040128:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.950695:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135655.950712:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545040640:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.950732:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135655.950759:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545040000 00000100:00100000:2.0:1789135655.950770:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545040000 00000100:00100000:2.0:1789135655.950816:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789135655.950825:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545040000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.950870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545040000:12345-0@lo:400:kworker.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135655.950877:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789135655.950907:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545040512 00000100:00100000:2.0:1789135655.950910:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545040512 00000100:00100000:2.0:1789135655.950939:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545040256 00000100:00100000:2.0:1789135655.950942:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545040256 00000100:00100000:2.0:1789135655.950955:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545040128 00000100:00100000:2.0:1789135655.950958:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545040128 00000100:00100000:2.0:1789135655.950971:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135655.950977:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545040512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.951008:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545040512:12345-0@lo:400:kworker.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135655.951014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135655.951026:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135655.951033:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545040256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.951088:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545040256:12345-0@lo:400:kworker.0 Request processed in 55us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135655.951094:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135655.951105:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789135655.951112:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545040128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.951138:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545040128:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135655.951144:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789135655.951169:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545040384 00000100:00100000:2.0:1789135655.951173:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545040384 00000100:00100000:2.0:1789135655.951197:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545040640 00000100:00100000:2.0:1789135655.951200:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545040640 00000100:00100000:2.0:1789135655.951355:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789135655.951364:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545040384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.951396:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545040384:12345-0@lo:400:kworker.0 Request processed in 35us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135655.951402:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789135655.951414:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789135655.951420:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545040640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.951445:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545040640:12345-0@lo:400:kworker.0 Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135655.951450:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789135655.951467:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135655.951470:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135655.951472:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135655.951502:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545040128:0@lo:400:kworker.0 00010000:00080000:2.0:1789135655.951514:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7e1c0 x1876044545040640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135655.951523:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545040640:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.951531:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545040256:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.951561:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545040000:0@lo:400:kworker.0 00000100:00100000:2.0:1789135655.951570:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545040512:0@lo:400:kworker.0 00010000:00080000:2.0:1789135655.951580:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7ed00 x1876044545040384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135655.951596:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545040384:0@lo:400:kworker.0 00000100:00100000:0.0:1789135656.466420:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135656.466441:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545040768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135656.466515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135656.466581:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545040768 00000100:00100000:0.0:1789135656.466588:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545040768 00000100:00100000:0.0:1789135656.466629:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789135656.466637:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545040768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135656.466680:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135656.466718:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545040768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135656.466725:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789135656.466770:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7c000 x1876044545040768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135656.466787:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545040768:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789135656.515811:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:2.0:1789135656.515820:0:6705:0:(genops.c:885:class_export_put()) final put ffff8adc41d66000/5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:0.0:1789135656.516889:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41d66000/5f7ef768-1508-4eda-9824-c10078b0a61e for lustre-OST0000 00000020:00000080:0.0:1789135656.516949:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc41d63800 for lustre-OST0000 00010000:00010000:3.0:1789135656.666567:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135656.898222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135656.898284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135656.898413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512501632 00000100:00100000:2.0:1789135656.898421:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512501632 00000100:00100000:2.0:1789135656.898476:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 200 00000100:00100000:2.0:1789135656.898488:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2377:x1876044512501632:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135656.898554:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2377:x1876044512501632:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 68us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135656.898562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 200 00000100:00100000:2.0:1789135656.898606:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512501760 00000100:00100000:2.0:1789135656.898610:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512501760 00000100:00100000:2.0:1789135656.898659:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:2.0:1789135656.898668:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512501760:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135656.898699:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512501760:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 32us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135656.898706:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00080000:2.0:1789135656.898812:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135657.484407:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545040896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135657.484476:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135657.484618:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545040896 00000100:00100000:1.0:1789135657.484626:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545040896 00000100:00100000:1.0:1789135657.484696:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789135657.484706:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545040896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135657.484737:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135657.484780:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545040896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135657.484787:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789135657.485683:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135657.485722:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fa1c0 x1876044545040896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135657.485741:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545040896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135657.686786:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135658.701346:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135659.724423:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135660.750327:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135661.068299:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545041280:0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.068389:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135661.068454:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789135661.068461:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545041152:0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.068485:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135661.068501:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545041664:0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.068525:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135661.068642:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545041664 00000100:00100000:2.0:1789135661.068650:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545041664 00000100:00100000:2.0:1789135661.068721:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789135661.068732:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545041664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135661.068782:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545041664:12345-0@lo:400:kworker.0 Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135661.068790:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789135661.068834:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545041408:0@lo:400:kworker.0 00000100:00100000:2.0:1789135661.068861:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135661.069461:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135661.069471:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545041024:0@lo:400:kworker.0 00000100:00100000:2.0:1789135661.069507:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135661.069533:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545041536:0@lo:400:kworker.0 00000100:00100000:2.0:1789135661.069558:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789135661.069773:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135661.069801:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545041024 00000100:00100000:0.0:1789135661.069806:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545041024 00000100:00100000:0.0:1789135661.069849:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789135661.069856:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545041024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.070148:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545041024:12345-0@lo:400:kworker.0 Request processed in 292us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135661.070156:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00010000:00080000:0.0:1789135661.070202:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7d680 x1876044545041664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135661.070215:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545041664:0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.070260:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545041280 00000100:00100000:0.0:1789135661.070264:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545041280 00000100:00100000:0.0:1789135661.070291:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545041152 00000100:00100000:0.0:1789135661.070294:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545041152 00000100:00100000:0.0:1789135661.070304:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545041536 00000100:00100000:0.0:1789135661.070306:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545041536 00000100:00100000:0.0:1789135661.070323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789135661.070330:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545041280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.070369:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545041280:12345-0@lo:400:kworker.0 Request processed in 39us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135661.070376:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789135661.070387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789135661.070394:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545041152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.070421:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545041152:12345-0@lo:400:kworker.0 Request processed in 27us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135661.070427:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789135661.070439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789135661.070445:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545041536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.070470:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545041536:12345-0@lo:400:kworker.0 Request processed in 26us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135661.070476:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789135661.070488:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135661.070503:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545041152:0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.070512:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545041280:0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.070539:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545041024:0@lo:400:kworker.0 00000100:00100000:0.0:1789135661.070557:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545041536:0@lo:400:kworker.0 00000100:00100000:2.0:1789135661.070688:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545041408 00000100:00100000:2.0:1789135661.071030:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545041408 00000100:00100000:2.0:1789135661.071084:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789135661.071092:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545041408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135661.071134:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545041408:12345-0@lo:400:kworker.0 Request processed in 44us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135661.071140:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789135661.071158:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135661.071176:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7cf00 x1876044545041408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135661.071187:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545041408:0@lo:400:kworker.0 00000100:00100000:1.0:1789135661.580791:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135661.580813:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545041792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135661.580883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135661.580953:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545041792 00000100:00100000:1.0:1789135661.580960:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545041792 00000100:00100000:1.0:1789135661.581785:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789135661.581799:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545041792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135661.581834:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135661.581906:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545041792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135661.581914:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789135661.582332:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057f92c0 x1876044545041792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135661.582363:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545041792:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789135661.725871:0:9238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.131 00010000:00010000:0.0:1789135661.772380:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135662.003265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135662.003301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135662.004885:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512501888 00000100:00100000:0.0:1789135662.004895:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512501888 00000100:00100000:0.0:1789135662.004951:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 202 00000100:00100000:0.0:1789135662.004961:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2377:x1876044512501888:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135662.005026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2377:x1876044512501888:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 67us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135662.005034:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 202 00000100:00100000:1.0:1789135662.005149:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512502016 00000100:00100000:1.0:1789135662.005154:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512502016 00000100:00100000:1.0:1789135662.005211:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:1.0:1789135662.005233:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512502016:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135662.005276:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512502016:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 51us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135662.005282:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00080000:0.0:1789135662.005744:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135662.604808:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1954d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545041920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135662.604889:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135662.605112:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545041920 00000100:00100000:0.0:1789135662.605120:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545041920 00000100:00100000:0.0:1789135662.605169:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135662.605178:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545041920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135662.605223:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135662.605264:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545041920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135662.605270:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789135662.605485:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc1954d680 x1876044545041920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135662.605503:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1954d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545041920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135662.796717:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135663.820887:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135664.841841:0:9336:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.131 00010000:00010000:1.0:1789135664.848558:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135665.868805:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135666.188439:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545042432:0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.188520:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135666.188566:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789135666.188572:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545042048:0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.188609:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135666.188630:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545042560:0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.188664:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135666.188688:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545042304:0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.188706:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135666.188720:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789135666.188725:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545042176:0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.188741:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135666.188754:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545042688:0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.188770:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135666.188791:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545042048 00000100:00100000:0.0:1789135666.188796:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545042048 00000100:00100000:0.0:1789135666.188831:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789135666.188839:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545042048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.188879:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545042048:12345-0@lo:400:kworker.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135666.188886:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789135666.188913:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545042560 00000100:00100000:0.0:1789135666.188916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545042560 00000100:00100000:0.0:1789135666.188944:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545042304 00000100:00100000:0.0:1789135666.188947:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545042304 00000100:00100000:0.0:1789135666.188958:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545042176 00000100:00100000:0.0:1789135666.188960:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545042176 00000100:00100000:0.0:1789135666.188971:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789135666.188977:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545042560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.189009:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545042560:12345-0@lo:400:kworker.0 Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135666.189015:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789135666.189026:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789135666.189039:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545042304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.189096:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545042304:12345-0@lo:400:kworker.0 Request processed in 58us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135666.189102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789135666.189113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135666.189120:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545042176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135666.189151:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545042304:0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.189287:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545042176:12345-0@lo:400:kworker.0 Request processed in 167us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135666.189316:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789135666.189341:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135666.189359:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545042048:0@lo:400:kworker.0 00000100:00100000:0.0:1789135666.189368:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545042560:0@lo:400:kworker.0 00000100:00100000:1.0:1789135666.189524:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545042176:0@lo:400:kworker.0 00000100:00100000:2.0:1789135666.189963:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545042432 00000100:00100000:2.0:1789135666.189968:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545042432 00000100:00100000:2.0:1789135666.190017:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545042688 00000100:00100000:2.0:1789135666.190020:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545042688 00000100:00100000:2.0:1789135666.190041:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789135666.190048:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545042432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135666.190103:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135666.190111:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545042688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135666.190121:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545042432:12345-0@lo:400:kworker.0 Request processed in 74us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135666.190127:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135666.190147:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545042688:12345-0@lo:400:kworker.0 Request processed in 38us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135666.190154:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789135666.190175:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057ffc00 x1876044545042688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789135666.190182:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fc000 x1876044545042432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135666.190186:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545042688:0@lo:400:kworker.0 00000100:00100000:2.0:1789135666.190192:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545042432:0@lo:400:kworker.0 00000100:00080000:0.0:1789135666.191628:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135666.191634:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135666.700974:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135666.701054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135666.701861:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545042816 00000100:00100000:0.0:1789135666.701871:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545042816 00000100:00100000:0.0:1789135666.701925:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135666.701934:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545042816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135666.701966:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135666.702030:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545042816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135666.702037:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789135666.702723:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fd2c0 x1876044545042816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135666.702743:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545042816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135666.894950:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135667.133102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135667.133141:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135667.133228:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512502144 00000100:00100000:3.0:1789135667.133237:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512502144 00000100:00100000:3.0:1789135667.133290:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 204 00000100:00100000:3.0:1789135667.133299:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2377:x1876044512502144:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135667.133450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2377:x1876044512502144:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 151us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135667.133458:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 204 00000100:00100000:0.0:1789135667.133460:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512502272 00000100:00100000:0.0:1789135667.133464:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512502272 00000100:00100000:0.0:1789135667.133501:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:0.0:1789135667.133516:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512502272:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135667.133546:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512502272:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 33us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135667.133553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00080000:0.0:1789135667.133569:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135667.724220:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135667.724241:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41908780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545042944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135667.724306:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135667.725549:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545042944 00000100:00100000:2.0:1789135667.725559:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545042944 00000100:00100000:2.0:1789135667.725635:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789135667.725645:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545042944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135667.725680:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135667.725743:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545042944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135667.725762:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789135667.725806:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41908780 x1876044545042944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135667.725826:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41908780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545042944:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789135667.911008:0:9433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.131 00010000:00010000:1.0:1789135667.917027:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135668.941570:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135669.966635:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789135670.594965:0:9482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 10:07:48 EDT 2026 00010000:00010000:1.0:1789135670.988509:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135671.311707:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545043456:0@lo:400:kworker.0 00000100:00100000:2.0:1789135671.311772:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135671.312046:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135671.312055:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545043072:0@lo:400:kworker.0 00000100:00100000:2.0:1789135671.312107:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135671.312298:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545043456 00000100:00100000:0.0:1789135671.312305:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545043456 00000100:00100000:0.0:1789135671.312363:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135671.312373:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545043456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135671.312904:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545043584:0@lo:400:kworker.0 00000100:00100000:2.0:1789135671.312935:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135671.312968:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545043072 00000100:00100000:2.0:1789135671.312987:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545043072 00000100:00100000:2.0:1789135671.313020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789135671.313027:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545043072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135671.313083:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545043072:12345-0@lo:400:kworker.0 Request processed in 57us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135671.313091:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789135671.313121:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545043584 00000100:00100000:0.0:1789135671.313333:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545043456:12345-0@lo:400:kworker.0 Request processed in 960us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135671.313341:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135671.313364:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545043328:0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.313390:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135671.313421:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789135671.313427:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545043200:0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.313449:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135671.313467:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545043712:0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.313502:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789135671.313699:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135671.313712:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545043712 00000100:00100000:0.0:1789135671.313716:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545043712 00000100:00100000:0.0:1789135671.313750:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789135671.313757:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545043712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.313793:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545043712:12345-0@lo:400:kworker.0 Request processed in 37us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135671.313812:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789135671.314251:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545043584 00000100:00100000:2.0:1789135671.314281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545043328 00000100:00100000:2.0:1789135671.314284:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545043328 00000100:00100000:2.0:1789135671.314296:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545043200 00000100:00100000:2.0:1789135671.314298:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545043200 00000100:00100000:2.0:1789135671.314308:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135671.314314:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41909a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545043584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135671.314352:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41909a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545043584:12345-0@lo:400:kworker.0 Request processed in 39us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135671.314358:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135671.314368:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789135671.314375:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545043328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135671.314397:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545043328:12345-0@lo:400:kworker.0 Request processed in 24us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135671.314403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789135671.314619:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789135671.314627:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545043200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.314659:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545043200:12345-0@lo:400:kworker.0 Request processed in 34us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135671.314664:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1789135671.314685:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135671.314688:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135671.314712:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545043200:0@lo:400:kworker.0 00010000:00080000:0.0:1789135671.314724:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc4190bc00 x1876044545043712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135671.314735:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545043712:0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.314745:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545043328:0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.314796:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545043072:0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.314805:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545043584:0@lo:400:kworker.0 00010000:00080000:0.0:1789135671.314816:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41908000 x1876044545043456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135671.315906:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545043456:0@lo:400:kworker.0 00000100:00100000:0.0:1789135671.831672:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135671.831691:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545043840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135671.831770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135671.831871:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545043840 00000100:00100000:1.0:1789135671.831880:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545043840 00000100:00100000:1.0:1789135671.831938:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135671.831949:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545043840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135671.831982:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135671.832033:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545043840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135671.832048:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789135671.832116:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fc000 x1876044545043840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135671.832135:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545043840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135672.017618:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135672.248493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135672.248541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135672.248580:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512502400 00000100:00100000:0.0:1789135672.248589:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512502400 00000100:00100000:0.0:1789135672.248636:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 206 00000100:00100000:0.0:1789135672.248646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512502400:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135672.248714:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512502400:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 60us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135672.248727:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 206 00000100:00100000:0.0:1789135672.248756:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512502528 00000100:00100000:0.0:1789135672.248760:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512502528 00000100:00100000:0.0:1789135672.248793:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:0.0:1789135672.248799:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512502528:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135672.248839:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512502528:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 39us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135672.248845:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00080000:0.0:1789135672.248862:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135672.844765:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135672.844786:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545043968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135672.844857:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135672.845143:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545043968 00000100:00100000:2.0:1789135672.845150:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545043968 00000100:00100000:2.0:1789135672.845205:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789135672.845216:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545043968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135672.845249:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135672.845304:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545043968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135672.845311:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789135672.845748:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc4190a940 x1876044545043968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135672.845768:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545043968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135673.039952:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135674.060349:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135675.085885:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135676.120083:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135676.430031:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545044096:0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.430141:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135676.430185:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545044608:0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.430212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135676.430238:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135676.430244:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545044480:0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.430267:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135676.430293:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545044224:0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.430314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135676.430329:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545044736:0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.430361:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135676.430695:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135676.430703:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545044352:0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.430729:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135676.430760:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545044096 00000100:00100000:1.0:1789135676.430766:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545044096 00000100:00100000:1.0:1789135676.430803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789135676.430811:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545044096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.430852:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545044096:12345-0@lo:400:kworker.0 Request processed in 42us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135676.430867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789135676.430907:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545044608 00000100:00100000:1.0:1789135676.430910:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545044608 00000100:00100000:1.0:1789135676.430937:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545044224 00000100:00100000:1.0:1789135676.430939:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545044224 00000100:00100000:1.0:1789135676.430949:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545044352 00000100:00100000:1.0:1789135676.430951:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545044352 00000100:00100000:1.0:1789135676.430965:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135676.430971:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545044608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.431000:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545044608:12345-0@lo:400:kworker.0 Request processed in 30us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135676.431007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135676.431019:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135676.431024:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.431050:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545044224:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135676.431055:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135676.431588:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789135676.431598:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545044352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.431630:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545044352:12345-0@lo:400:kworker.0 Request processed in 35us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135676.431635:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789135676.431655:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545044480 00000100:00100000:1.0:1789135676.431659:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545044480 00000100:00100000:1.0:1789135676.431786:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545044736 00000100:00100000:1.0:1789135676.431790:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545044736 00000100:00100000:0.0:1789135676.449077:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789135676.449103:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545044480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135676.449199:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545044480:12345-0@lo:400:kworker.0 Request processed in 110us (18931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135676.449208:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789135676.449251:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789135676.449259:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545044736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135676.449304:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545044736:12345-0@lo:400:kworker.0 Request processed in 47us (18943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135676.449311:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789135676.452999:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135676.453009:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135676.453012:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135676.453205:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057f92c0 x1876044545044480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135676.453222:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545044480:0@lo:400:kworker.0 00000100:00100000:0.0:1789135676.453235:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545044096:0@lo:400:kworker.0 00000100:00100000:0.0:1789135676.453631:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545044608:0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.459380:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545044352:0@lo:400:kworker.0 00000100:00100000:1.0:1789135676.459409:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545044224:0@lo:400:kworker.0 00010000:00080000:1.0:1789135676.459423:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fb840 x1876044545044736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135676.459433:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545044736:0@lo:400:kworker.0 00000100:00100000:0.0:1789135676.941306:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545044864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135676.941369:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135676.941409:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545044864 00000100:00100000:2.0:1789135676.941427:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545044864 00000100:00100000:2.0:1789135676.941476:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789135676.941485:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545044864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135676.941514:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135676.941569:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545044864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135676.941576:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789135676.941839:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fe580 x1876044545044864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135676.941857:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545044864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789135677.138331:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135677.371921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135677.371958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135677.372001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512502784 00000100:00100000:0.0:1789135677.372010:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512502784 00000100:00100000:0.0:1789135677.372085:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:0.0:1789135677.372095:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512502784:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135677.372364:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512502656 00000100:00100000:2.0:1789135677.372369:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512502656 00000100:00100000:2.0:1789135677.372405:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 208 00000100:00100000:2.0:1789135677.372412:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512502656:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135677.372464:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512502656:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 53us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135677.372471:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 208 00000100:00080000:2.0:1789135677.372599:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135677.374576:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512502784:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 2476us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135677.374588:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:2.0:1789135677.964325:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545044992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135677.964401:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135677.964471:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545044992 00000100:00100000:0.0:1789135677.964479:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545044992 00000100:00100000:0.0:1789135677.964550:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135677.964558:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545044992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135677.964588:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135677.964628:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545044992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135677.964635:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789135677.964888:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342ba580 x1876044545044992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135677.964905:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545044992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135678.157256:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135679.180503:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135680.206818:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135681.238818:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135681.554831:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545045120:0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.554900:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135681.554926:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545045248:0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.554952:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545045632:0@lo:400:kworker.0 00000100:00100000:0.0:1789135681.554977:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135681.554992:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545045504:0@lo:400:kworker.0 00000100:00100000:0.0:1789135681.555010:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545045760:0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.555025:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135681.555048:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135681.555100:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545045376:0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.557495:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135681.557575:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545045120 00000100:00100000:3.0:1789135681.557582:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545045120 00000100:00100000:3.0:1789135681.557629:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789135681.557638:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545045120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.557697:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545045120:12345-0@lo:400:kworker.0 Request processed in 60us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135681.557705:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789135681.558481:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545045504 00000100:00100000:3.0:1789135681.558491:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545045504 00000100:00100000:3.0:1789135681.558555:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545045760 00000100:00100000:3.0:1789135681.558559:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545045760 00000100:00100000:3.0:1789135681.558588:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135681.558596:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545045504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.558651:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545045504:12345-0@lo:400:kworker.0 Request processed in 56us (3626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135681.558659:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135681.558674:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789135681.558682:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545045760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.558716:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545045760:12345-0@lo:400:kworker.0 Request processed in 35us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135681.559445:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789135681.559474:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135681.559479:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135681.559530:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41d78f00 x1876044545045504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135681.559547:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545045504:0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.559581:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135681.559626:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545045120:0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.559651:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545045248 00000100:00100000:3.0:1789135681.559657:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545045248 00000100:00100000:3.0:1789135681.559696:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545045376 00000100:00100000:3.0:1789135681.559699:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545045376 00000100:00100000:3.0:1789135681.559720:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545045632 00000100:00100000:3.0:1789135681.560447:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545045632 00000100:00100000:3.0:1789135681.560476:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789135681.560483:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545045248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.560558:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545045248:12345-0@lo:400:kworker.0 Request processed in 75us (5582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135681.560565:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789135681.560579:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789135681.560584:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.560617:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545045376:12345-0@lo:400:kworker.0 Request processed in 33us (3128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135681.560623:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789135681.560632:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789135681.560638:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545045632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.560668:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545045632:12345-0@lo:400:kworker.0 Request processed in 31us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135681.560674:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789135681.560695:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135681.560717:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545045632:0@lo:400:kworker.0 00000100:00100000:3.0:1789135681.561229:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545045376:0@lo:400:kworker.0 00010000:00080000:0.0:1789135681.563891:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ea940 x1876044545045760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135681.563908:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545045760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135681.563941:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545045248:0@lo:400:kworker.0 00000100:00100000:1.0:1789135682.065268:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545045888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135682.065333:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135682.072935:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545045888 00000100:00100000:1.0:1789135682.072948:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545045888 00000100:00100000:1.0:1789135682.073011:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789135682.073020:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545045888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135682.073056:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1789135682.075731:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc057fb840 x1876044545045888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135682.075758:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545045888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135682.075847:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545045888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2826us (10511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135682.075857:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789135682.252290:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135682.495143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135682.495179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135682.495257:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512502912 00000100:00100000:1.0:1789135682.495266:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512502912 00000100:00100000:1.0:1789135682.495321:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 210 00000100:00100000:1.0:1789135682.495330:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512502912:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135682.495394:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2375:x1876044512502912:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 64us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135682.495401:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 210 00000100:00100000:3.0:1789135682.495591:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512503040 00000100:00100000:3.0:1789135682.495596:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512503040 00000100:00100000:3.0:1789135682.495645:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:3.0:1789135682.495652:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512503040:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135682.495695:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512503040:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 43us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135682.495702:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00080000:0.0:1789135682.495945:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135683.086001:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545046016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135683.086085:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135683.087224:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545046016 00000100:00100000:3.0:1789135683.087235:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545046016 00000100:00100000:3.0:1789135683.087301:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789135683.087310:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545046016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135683.087349:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135683.087410:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545046016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135683.087416:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789135683.087455:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346e9e00 x1876044545046016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135683.087471:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545046016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789135683.087534:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789135683.281751:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135684.309518:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135685.328550:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135686.352220:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135686.683747:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545046272:0@lo:400:kworker.0 00000100:00100000:1.0:1789135686.683827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135686.683873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545046784:0@lo:400:kworker.0 00000100:00100000:1.0:1789135686.683899:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135686.683931:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135686.683937:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545046400:0@lo:400:kworker.0 00000100:00100000:1.0:1789135686.683966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135686.683994:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545046784 00000100:00100000:1.0:1789135686.684000:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545046784 00000100:00100000:1.0:1789135686.684056:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789135686.684092:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545046784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135686.684142:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545046784:12345-0@lo:400:kworker.0 Request processed in 52us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135686.684150:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789135686.684184:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789135686.684212:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3a3003c0 x1876044545046784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135686.684226:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545046784:0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.684443:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545046528:0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.684475:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135686.684507:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789135686.684513:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545046144:0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.684551:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135686.684576:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a303c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545046656:0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.684597:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135686.684627:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545046272 00000100:00100000:0.0:1789135686.684631:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545046272 00000100:00100000:0.0:1789135686.684661:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545046400 00000100:00100000:0.0:1789135686.684665:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545046400 00000100:00100000:0.0:1789135686.684682:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545046656 00000100:00100000:0.0:1789135686.684684:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545046656 00000100:00100000:0.0:1789135686.684697:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789135686.684703:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545046272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.684740:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545046272:12345-0@lo:400:kworker.0 Request processed in 37us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135686.684747:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789135686.684764:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789135686.684770:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545046400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.684811:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a302940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545046400:12345-0@lo:400:kworker.0 Request processed in 41us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135686.684817:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789135686.684828:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789135686.684835:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545046656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.684866:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545046656:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135686.684872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789135686.684892:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545046144 00000100:00100000:0.0:1789135686.684896:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545046144 00000100:00100000:0.0:1789135686.684919:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789135686.684933:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545046144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.684963:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545046144:12345-0@lo:400:kworker.0 Request processed in 32us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135686.684969:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1789135686.685001:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135686.685019:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545046144:0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.685030:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a303c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545046656:0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.685056:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545046400:0@lo:400:kworker.0 00000100:00100000:0.0:1789135686.685091:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545046272:0@lo:400:kworker.0 00000100:00100000:1.0:1789135686.686456:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545046528 00000100:00100000:1.0:1789135686.686466:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545046528 00000100:00100000:1.0:1789135686.686545:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135686.686554:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545046528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135686.686645:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545046528:12345-0@lo:400:kworker.0 Request processed in 92us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135686.686661:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789135686.688198:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3a3021c0 x1876044545046528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135686.688217:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545046528:0@lo:400:kworker.0 00000100:00080000:0.0:1789135686.688385:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789135686.712254:0:10112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:08:05 (1789135685) === 00000100:00100000:2.0:1789135687.184241:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135687.184267:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545046912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135687.184338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135687.184562:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545046912 00000100:00100000:3.0:1789135687.184570:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545046912 00000100:00100000:3.0:1789135687.184624:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789135687.184634:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41909e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545046912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135687.184668:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135687.184723:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41909e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545046912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135687.184749:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789135687.184969:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3a3021c0 x1876044545046912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135687.184987:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545046912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135687.222713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135687.222825:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512503168 00000100:00100000:0.0:1789135687.222835:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512503168 00000100:00100000:0.0:1789135687.222898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 212 00000100:00100000:0.0:1789135687.222918:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+10:8184:x1876044512503168:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789135687.222935:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135687.222951:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3fc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d349a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135687.222983:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d349a expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135687.222994:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d349a expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135687.223003:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030200, rc 0) 00000100:00100000:0.0:1789135687.223560:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8184:x1876044512503168:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 145us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135687.223584:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 212 00000100:00100000:3.0:1789135687.227389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135687.229664:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512503296 00000100:00100000:0.0:1789135687.229678:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512503296 00000100:00100000:0.0:1789135687.229743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 213 00000100:00100000:0.0:1789135687.229754:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8184:x1876044512503296:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789135687.230043:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8184:x1876044512503296:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 290us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135687.230050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 213 00000100:00100000:2.0:1789135687.233784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135687.233873:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512503424 00000100:00100000:3.0:1789135687.233883:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512503424 00000100:00100000:3.0:1789135687.233937:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 214 00000100:00100000:3.0:1789135687.233947:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8184:x1876044512503424:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789135687.234352:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8184:x1876044512503424:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 405us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135687.234361:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 214 00000100:00100000:1.0:1789135687.255925:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135687.256012:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512503552 00000100:00100000:3.0:1789135687.256022:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512503552 00000100:00100000:3.0:1789135687.256605:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 215 00000100:00100000:3.0:1789135687.256616:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8188:x1876044512503552:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135687.256893:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8188:x1876044512503552:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 278us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135687.256901:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 215 00000100:00100000:1.0:1789135687.300171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135687.300917:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512503680 00000100:00100000:0.0:1789135687.300927:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512503680 00000100:00100000:0.0:1789135687.300996:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 216 00000100:00100000:0.0:1789135687.301006:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8188:x1876044512503680:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135687.306160:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8188:x1876044512503680:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 5145us (5990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135687.306175:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 216 00000100:00100000:2.0:1789135687.318672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135687.318903:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512503808 00000100:00100000:3.0:1789135687.318912:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512503808 00000100:00100000:3.0:1789135687.318980:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 217 00000100:00100000:3.0:1789135687.318990:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+11:8184:x1876044512503808:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789135687.319006:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135687.319022:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3fca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d34c4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135687.319049:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34c4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135687.319115:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34c4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135687.319124:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc029e4a00, rc 0) 00000100:00100000:3.0:1789135687.319172:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:8184:x1876044512503808:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 184us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135687.319179:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 217 00000100:00100000:1.0:1789135687.327026:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135687.327384:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512503936 00000100:00100000:2.0:1789135687.327393:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512503936 00000100:00100000:2.0:1789135687.327454:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 218 00000100:00100000:2.0:1789135687.327473:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:8184:x1876044512503936:12345-192.168.206.35@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789135687.327519:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789135687.327534:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789135687.327538:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789135687.327553:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789135687.327556:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789135687.337155:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:8184:x1876044512503936:12345-192.168.206.35@tcp:256:mount.lustre.0 Request processed in 9682us (10126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135687.337170:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 218 00000100:00100000:1.0:1789135687.344149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135687.344260:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512504064 00000100:00100000:0.0:1789135687.344270:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512504064 00000100:00100000:0.0:1789135687.344320:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 219 00000100:00100000:0.0:1789135687.344331:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:8184:x1876044512504064:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789135687.344347:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135687.344363:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d34cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135687.344393:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135687.344403:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135687.344429:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031400, rc 0) 00000100:00100000:0.0:1789135687.344609:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8184:x1876044512504064:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 279us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135687.344617:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 219 00000100:00100000:1.0:1789135687.356515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135687.356632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512504192 00000100:00100000:2.0:1789135687.356642:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512504192 00000100:00100000:2.0:1789135687.356701:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 220 00000100:00100000:2.0:1789135687.356711:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8184:x1876044512504192:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789135687.357007:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8184:x1876044512504192:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 297us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135687.357015:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 220 00000100:00100000:1.0:1789135687.360929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135687.361980:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512504320 00000100:00100000:0.0:1789135687.361991:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512504320 00000100:00100000:0.0:1789135687.362056:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 221 00000100:00100000:0.0:1789135687.362106:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8184:x1876044512504320:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789135687.362606:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8184:x1876044512504320:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 540us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135687.362615:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 221 00000100:00100000:1.0:1789135687.367101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135687.367191:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512504448 00000100:00100000:3.0:1789135687.367201:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512504448 00000100:00100000:3.0:1789135687.367266:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 222 00000100:00100000:3.0:1789135687.367276:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8191:x1876044512504448:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135687.367554:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8191:x1876044512504448:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 279us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135687.367562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 222 00000100:00100000:3.0:1789135687.372341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135687.374649:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512504576 00000100:00100000:2.0:1789135687.374664:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512504576 00000100:00100000:2.0:1789135687.374729:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 223 00000100:00100000:2.0:1789135687.374751:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8191:x1876044512504576:12345-192.168.206.35@tcp:502:llog_process_th.0 00010000:00010000:3.0:1789135687.374860:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135687.375007:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:8191:x1876044512504576:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 258us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135687.375016:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 223 00000100:00100000:2.0:1789135687.391847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135687.391888:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135687.391959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512505088 00000100:00100000:0.0:1789135687.391968:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512505088 00000100:00100000:0.0:1789135687.392036:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512504704 00000100:00100000:0.0:1789135687.392040:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512504704 00000100:00100000:0.0:1789135687.392104:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:0.0:1789135687.392114:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41908b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512505088:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135687.392181:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41908b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512505088:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 69us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135687.392188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:0.0:1789135687.392205:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:0.0:1789135687.392209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41908f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2374:x1876044512504704:12345-192.168.206.35@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789135687.392231:0:5837:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d573bc19-f13c-42b5-94dc-b94e81618c9c@192.168.206.35@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1789135687.392262:0:5837:0:(genops.c:1385:class_connect()) connect: client d573bc19-f13c-42b5-94dc-b94e81618c9c, cookie 0x5b09da6ee1ce3fd8 00000100:00080000:3.0:1789135687.392385:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00100000:0.0:1789135687.392745:0:5837:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789135687.393451:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8adc34b9c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135687.393565:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41908f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2374:x1876044512504704:12345-192.168.206.35@tcp:38:mount.lustre.0 Request processed in 1352us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135687.393587:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1789135687.402183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135687.402642:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512504960 00000100:00100000:3.0:1789135687.402652:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512504960 00000100:00100000:1.0:1789135687.402804:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1789135687.402818:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:8184:x1876044512504960:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789135687.402873:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789135687.402968:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:8184:x1876044512504960:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 153us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135687.402976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00080000:0.0:1789135687.403656:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135687.416164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135687.416247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135687.416568:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512504832 00000100:00100000:2.0:1789135687.416589:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512504832 00000100:00100000:2.0:1789135687.416647:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512505216 00000100:00100000:2.0:1789135687.416650:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512505216 00000100:00100000:2.0:1789135687.416679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:2.0:1789135687.416688:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+7:0:x1876044512504832:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789135687.416718:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789135687.416797:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+7:0:x1876044512504832:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 110us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135687.416805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1789135687.416813:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:3.0:1789135687.416822:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:8184:x1876044512505216:12345-192.168.206.35@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789135687.416854:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:8184:x1876044512505216:12345-192.168.206.35@tcp:40:mount.lustre.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135687.416861:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:2.0:1789135687.419115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135687.419298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135687.419368:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512505600 00000100:00100000:3.0:1789135687.419385:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512505600 00000100:00100000:3.0:1789135687.419428:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:3.0:1789135687.419436:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:8184:x1876044512505600:12345-192.168.206.35@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789135687.419631:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512505344 00000100:00100000:1.0:1789135687.419635:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512505344 00000100:00100000:1.0:1789135687.419665:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1789135687.419670:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1876044512505344:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789135687.419691:0:6681:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d573bc19-f13c-42b5-94dc-b94e81618c9c@192.168.206.35@tcp t0 exp 0000000000000000 cur 310 last 0 00000004:00200000:3.0:1789135687.419717:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000020:00000080:1.0:1789135687.419737:0:6681:0:(genops.c:1385:class_connect()) connect: client d573bc19-f13c-42b5-94dc-b94e81618c9c, cookie 0x5b09da6ee1ce3fdf 00002000:00100000:1.0:1789135687.419747:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d573bc19-f13c-42b5-94dc-b94e81618c9c/ffff8adc03e03800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789135687.419766:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789135687.419844:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:8184:x1876044512505600:12345-192.168.206.35@tcp:33:mount.lustre.0 Request processed in 407us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135687.419852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00002000:00080000:1.0:1789135687.419933:0:6681:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789135687.419959:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8adc03e02800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135687.419993:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2374:x1876044512505344:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 322us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135687.420000:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:2.0:1789135687.425448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135687.429817:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512505472 00000100:00100000:1.0:1789135687.429833:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512505472 00000100:00100000:1.0:1789135687.429901:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1789135687.429909:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2374:x1876044512505472:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789135687.429951:0:6682:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d573bc19-f13c-42b5-94dc-b94e81618c9c@192.168.206.35@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:1.0:1789135687.429980:0:6682:0:(genops.c:1385:class_connect()) connect: client d573bc19-f13c-42b5-94dc-b94e81618c9c, cookie 0x5b09da6ee1ce3fe6 00002000:00100000:1.0:1789135687.429992:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d573bc19-f13c-42b5-94dc-b94e81618c9c/ffff8adc03e00800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789135687.430003:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789135687.430277:0:6682:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789135687.430512:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8adc03e07000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135687.430591:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2374:x1876044512505472:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 680us (5152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135687.430600:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:2.0:1789135688.210949:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a303840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545047040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135688.211012:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135688.212349:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545047040 00000100:00100000:3.0:1789135688.212360:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545047040 00000100:00100000:3.0:1789135688.212435:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135688.212445:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545047040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135688.212486:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789135688.212567:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135688.222097:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545047040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9643us (11073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135688.222113:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789135688.228249:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3a303840 x1876044545047040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135688.228278:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a303840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545047040:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135688.396253:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135689.420323:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789135690.349552:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d573bc19-f13c-42b5-94dc-b94e81618c9c 00010000:00010000:3.0:1789135690.444581:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789135691.356948:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d573bc19-f13c-42b5-94dc-b94e81618c9c 00010000:00010000:1.0:1789135691.468887:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135691.789780:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545047424:0@lo:400:kworker.0 00000100:00100000:0.0:1789135691.789780:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545047296:0@lo:400:kworker.0 00000100:00100000:3.0:1789135691.789854:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545047168:0@lo:400:kworker.0 00000100:00100000:1.0:1789135691.789905:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41908780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545047552:0@lo:400:kworker.0 00000100:00100000:0.0:1789135691.790521:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135691.790571:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545047808:0@lo:400:kworker.0 00000100:00100000:0.0:1789135691.790597:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135691.790642:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545047808 00000100:00100000:0.0:1789135691.790648:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545047808 00000100:00100000:0.0:1789135691.790822:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789135691.790831:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545047808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135691.790881:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545047808:12345-0@lo:400:kworker.0 Request processed in 52us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135691.790889:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789135691.790925:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ed680 x1876044545047808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135691.790939:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545047808:0@lo:400:kworker.0 00000100:00100000:2.0:1789135691.791138:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135691.791178:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545047296 00000100:00100000:2.0:1789135691.791182:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545047296 00000100:00100000:2.0:1789135691.791213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545047424 00000100:00100000:2.0:1789135691.791216:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545047424 00000100:00100000:2.0:1789135691.791235:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789135691.791243:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545047296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135691.791282:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545047296:12345-0@lo:400:kworker.0 Request processed in 40us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135691.791297:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789135691.791310:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789135691.791317:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545047424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135691.791353:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545047424:12345-0@lo:400:kworker.0 Request processed in 37us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135691.791359:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789135691.791392:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545047296:0@lo:400:kworker.0 00000100:00100000:2.0:1789135691.791413:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545047424:0@lo:400:kworker.0 00000100:00080000:2.0:1789135691.791443:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135691.791448:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135691.794868:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135691.794922:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545047680:0@lo:400:kworker.0 00000100:00100000:3.0:1789135691.794957:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135691.794972:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545047168 00000100:00100000:0.0:1789135691.794980:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545047168 00000100:00100000:0.0:1789135691.795025:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789135691.795035:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545047168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135691.795151:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545047680 00000100:00100000:2.0:1789135691.795156:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545047680 00000100:00100000:2.0:1789135691.795199:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789135691.795208:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545047680:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789135691.795288:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135691.799288:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545047168:12345-0@lo:400:kworker.0 Request processed in 4244us (4416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135691.799302:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789135691.803878:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135691.804177:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545047680:12345-0@lo:400:kworker.0 Request processed in 8968us (9217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135691.804190:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789135691.805269:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545047552 00000100:00100000:0.0:1789135691.805280:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545047552 00000100:00100000:0.0:1789135691.805363:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135691.805373:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545047552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789135691.807257:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135691.807529:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545047552:12345-0@lo:400:kworker.0 Request processed in 2154us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135691.807541:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789135691.811392:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41908780 x1876044545047552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135691.811412:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41908780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545047552:0@lo:400:kworker.0 00000100:00100000:3.0:1789135691.812305:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545047168:0@lo:400:kworker.0 00000100:00100000:3.0:1789135691.812328:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545047680:0@lo:400:kworker.0 00000100:00100000:0.0:1789135692.300566:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135692.300589:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545047936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135692.300668:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135692.300887:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545047936 00000100:00100000:1.0:1789135692.300894:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545047936 00000100:00100000:1.0:1789135692.300945:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789135692.300954:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545047936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135692.300987:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135692.301043:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545047936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135692.301050:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789135692.303177:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3a301e00 x1876044545047936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135692.303204:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545047936:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789135692.467332:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d573bc19-f13c-42b5-94dc-b94e81618c9c 00010000:00010000:1.0:1789135692.492278:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135692.722949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135692.722996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135692.723056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135692.723096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135692.723119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135692.723147:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512506112 00000100:00100000:3.0:1789135692.723156:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512506112 00000100:00100000:3.0:1789135692.723209:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512506240 00000100:00100000:3.0:1789135692.723212:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512506240 00000100:00100000:3.0:1789135692.723235:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:3.0:1789135692.723243:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512506112:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135692.723332:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512506112:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 90us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135692.723340:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:3.0:1789135692.723354:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:3.0:1789135692.723361:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512506240:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135692.723385:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512506240:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135692.723392:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00080000:3.0:1789135692.723407:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135692.723411:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135692.723548:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512505728 00000100:00100000:3.0:1789135692.723552:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512505728 00000100:00100000:3.0:1789135692.723577:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 225 00000100:00100000:3.0:1789135692.723584:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512505728:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135692.723614:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512505728:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135692.723620:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 225 00000100:00100000:3.0:1789135692.723687:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512505856 00000100:00100000:3.0:1789135692.723690:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512505856 00000100:00100000:3.0:1789135692.723719:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512505984 00000100:00100000:3.0:1789135692.723721:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512505984 00000100:00100000:3.0:1789135692.723740:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:3.0:1789135692.723747:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512505856:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135692.723778:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512505856:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 32us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135692.723784:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:3.0:1789135692.723795:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:3.0:1789135692.723800:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512505984:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135692.723820:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512505984:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 19us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135692.723825:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00080000:3.0:1789135692.723839:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135693.324867:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545048064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135693.324947:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135693.325194:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545048064 00000100:00100000:2.0:1789135693.325204:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545048064 00000100:00100000:2.0:1789135693.325735:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789135693.325750:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545048064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135693.325792:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135693.325851:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545048064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135693.325858:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789135693.326205:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135693.329725:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ec000 x1876044545048064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135693.329756:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545048064:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789135693.353982:0:10309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789135693.516291:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135694.546879:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135695.564328:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135696.588910:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135696.908578:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545048192:0@lo:400:kworker.0 00000100:00100000:3.0:1789135696.908771:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135696.908876:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545048320:0@lo:400:kworker.0 00000100:00100000:0.0:1789135696.908913:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135696.909004:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545048320 00000100:00100000:0.0:1789135696.909010:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545048320 00000100:00100000:0.0:1789135696.909055:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789135696.909091:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545048320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135696.909142:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545048320:12345-0@lo:400:kworker.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135696.909150:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789135696.909193:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545048320:0@lo:400:kworker.0 00000100:00100000:0.0:1789135696.909230:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545048448:0@lo:400:kworker.0 00000100:00100000:0.0:1789135696.909256:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135696.909302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545048448 00000100:00100000:0.0:1789135696.909306:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545048448 00000100:00100000:0.0:1789135696.909334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789135696.909340:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545048448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135696.909372:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545048448:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135696.909393:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789135696.909409:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135696.909439:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545048448:0@lo:400:kworker.0 00000100:00100000:0.0:1789135696.909479:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545048832:0@lo:400:kworker.0 00000100:00100000:0.0:1789135696.909502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135696.909531:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545048832 00000100:00100000:0.0:1789135696.909535:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545048832 00000100:00100000:0.0:1789135696.909560:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789135696.909566:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545048832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135696.909598:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545048832:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135696.909604:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1789135696.909619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135696.909990:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545048704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135696.910016:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135696.910033:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135696.910039:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545048576:0@lo:400:kworker.0 00000100:00100000:3.0:1789135696.910057:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135696.910104:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545048576 00000100:00100000:3.0:1789135696.910107:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545048576 00000100:00100000:3.0:1789135696.910143:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789135696.910150:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545048576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135696.910183:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545048576:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135696.910190:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789135696.910203:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135696.910221:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7e580 x1876044545048576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135696.910232:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545048576:0@lo:400:kworker.0 00000100:00100000:3.0:1789135696.910366:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545048704 00000100:00100000:3.0:1789135696.910371:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545048704 00000100:00100000:3.0:1789135696.910401:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789135696.910407:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545048704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135696.910455:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545048704:12345-0@lo:400:kworker.0 Request processed in 48us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135696.910462:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789135696.910475:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135696.910491:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545048704:0@lo:400:kworker.0 00010000:00080000:0.0:1789135696.914024:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7c780 x1876044545048832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135696.914043:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545048832:0@lo:400:kworker.0 00000100:00100000:1.0:1789135696.918468:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545048192 00000100:00100000:1.0:1789135696.918482:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545048192 00000100:00100000:1.0:1789135696.918550:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789135696.918560:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545048192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135696.918800:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545048192:12345-0@lo:400:kworker.0 Request processed in 241us (10029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135696.918808:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789135696.924823:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545048192:0@lo:400:kworker.0 00000100:00100000:3.0:1789135697.439817:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135697.439840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545048960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135697.439907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135697.439977:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545048960 00000100:00100000:3.0:1789135697.439983:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545048960 00000100:00100000:3.0:1789135697.440037:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789135697.440047:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545048960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135697.440117:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135697.440161:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545048960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135697.440168:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789135697.440208:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346e83c0 x1876044545048960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135697.440228:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545048960:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135697.612651:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135697.855874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135697.855917:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135697.855952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135697.855976:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135697.856053:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135697.856106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512506496 00000100:00100000:0.0:1789135697.856115:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512506496 00000100:00100000:0.0:1789135697.856169:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512506624 00000100:00100000:0.0:1789135697.856173:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512506624 00000100:00100000:0.0:1789135697.856207:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:0.0:1789135697.856216:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512506496:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135697.856286:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512506496:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 70us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135697.856295:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:0.0:1789135697.856311:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:0.0:1789135697.856318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512506624:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135697.856343:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512506624:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135697.856350:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:0.0:1789135697.856369:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512506880 00000100:00100000:0.0:1789135697.856373:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512506880 00000100:00100000:0.0:1789135697.856394:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512506752 00000100:00100000:0.0:1789135697.856397:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512506752 00000100:00100000:0.0:1789135697.856414:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:0.0:1789135697.856435:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512506880:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135697.856470:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512506880:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135697.856477:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:0.0:1789135697.856488:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:0.0:1789135697.856494:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512506752:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135697.856519:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512506752:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 25us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135697.856525:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1789135697.857122:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512506368 00000100:00100000:1.0:1789135697.857128:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512506368 00000100:00100000:1.0:1789135697.857162:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 227 00000100:00100000:1.0:1789135697.857171:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512506368:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135697.857203:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512506368:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 33us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135697.857209:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 227 00000100:00080000:3.0:1789135697.857357:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135697.857362:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135697.857365:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135698.446882:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135698.446909:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545049088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135698.446988:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135698.447256:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545049088 00000100:00100000:2.0:1789135698.447268:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545049088 00000100:00100000:2.0:1789135698.447342:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789135698.447355:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545049088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135698.447391:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135698.447476:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545049088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135698.447484:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789135698.447525:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346efc00 x1876044545049088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135698.447545:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545049088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789135698.447623:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789135698.636381:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135699.660349:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135700.685662:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135701.714917:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135702.028345:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545049472:0@lo:400:kworker.0 00000100:00100000:3.0:1789135702.028423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135702.028490:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789135702.028497:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545049344:0@lo:400:kworker.0 00000100:00100000:3.0:1789135702.028521:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135702.028539:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545049856:0@lo:400:kworker.0 00000100:00100000:3.0:1789135702.028563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135702.028597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545049472 00000100:00100000:3.0:1789135702.028604:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545049472 00000100:00100000:3.0:1789135702.028649:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545049344 00000100:00100000:3.0:1789135702.028653:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545049344 00000100:00100000:3.0:1789135702.028672:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789135702.028680:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545049472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135702.028740:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545049472:12345-0@lo:400:kworker.0 Request processed in 61us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135702.028747:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789135702.028764:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789135702.028770:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545049344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135702.028797:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545049344:12345-0@lo:400:kworker.0 Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135702.028803:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789135702.028916:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545049216:0@lo:400:kworker.0 00000100:00100000:2.0:1789135702.028947:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135702.029238:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545049600:0@lo:400:kworker.0 00000100:00100000:1.0:1789135702.029267:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135702.030029:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545049856 00000100:00100000:0.0:1789135702.030036:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545049856 00000100:00100000:0.0:1789135702.030093:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545049600 00000100:00100000:0.0:1789135702.030096:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545049600 00000100:00100000:0.0:1789135702.030118:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789135702.030126:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135702.030182:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545049856:12345-0@lo:400:kworker.0 Request processed in 57us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135702.030189:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789135702.030201:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789135702.030207:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545049600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135702.030241:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545049600:12345-0@lo:400:kworker.0 Request processed in 34us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135702.030247:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789135702.030529:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545049728:0@lo:400:kworker.0 00000100:00100000:2.0:1789135702.030559:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135702.030620:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545049728 00000100:00100000:2.0:1789135702.030624:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545049728 00000100:00100000:2.0:1789135702.030647:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789135702.030653:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545049728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135702.030695:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545049728:12345-0@lo:400:kworker.0 Request processed in 42us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135702.030701:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789135702.030719:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135702.030723:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135702.030725:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135702.030747:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545049728:0@lo:400:kworker.0 00000100:00100000:2.0:1789135702.030771:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545049344:0@lo:400:kworker.0 00010000:00080000:2.0:1789135702.030782:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342b83c0 x1876044545049856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135702.030793:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545049856:0@lo:400:kworker.0 00000100:00100000:2.0:1789135702.030802:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545049472:0@lo:400:kworker.0 00000100:00100000:2.0:1789135702.030949:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545049216 00000100:00100000:2.0:1789135702.030953:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545049216 00000100:00100000:2.0:1789135702.031018:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789135702.031025:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545049216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135702.031057:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545049216:12345-0@lo:400:kworker.0 Request processed in 32us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135702.031079:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00080000:1.0:1789135702.031151:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc04e7c780 x1876044545049600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135702.031162:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545049600:0@lo:400:kworker.0 00000100:00100000:3.0:1789135702.031775:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545049216:0@lo:400:kworker.0 00000100:00100000:0.0:1789135702.540657:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc342b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545049984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135702.540719:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135702.540830:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545049984 00000100:00100000:3.0:1789135702.540837:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545049984 00000100:00100000:3.0:1789135702.540886:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789135702.540895:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545049984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135702.540927:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135702.540983:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545049984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135702.540991:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789135702.541032:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc342b83c0 x1876044545049984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135702.541050:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc342b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545049984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135702.752166:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135702.966003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135702.966048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135702.966099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135702.966106:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512507008 00000100:00100000:1.0:1789135702.966115:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512507008 00000100:00100000:3.0:1789135702.966127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135702.966147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135702.966161:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 229 00000100:00100000:1.0:1789135702.966169:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512507008:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135702.966179:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512507520 00000100:00100000:3.0:1789135702.966182:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512507520 00000100:00100000:3.0:1789135702.966214:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512507392 00000100:00100000:3.0:1789135702.966217:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512507392 00000100:00100000:3.0:1789135702.966236:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:3.0:1789135702.966242:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512507520:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135702.966255:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512507008:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135702.966270:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512507520:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135702.966276:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:1.0:1789135702.966276:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 229 00000100:00100000:3.0:1789135702.966291:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:3.0:1789135702.966297:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512507392:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135702.966319:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512507392:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 22us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135702.966599:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512507264 00000100:00100000:2.0:1789135702.966604:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512507264 00000100:00100000:2.0:1789135702.966636:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512507136 00000100:00100000:2.0:1789135702.966640:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512507136 00000100:00100000:2.0:1789135702.966672:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:2.0:1789135702.966679:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512507264:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135702.966733:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512507264:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 45us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135702.966740:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:2.0:1789135702.966755:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:2.0:1789135702.966762:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512507136:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135702.966789:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512507136:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135702.966794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00080000:2.0:1789135702.966817:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135702.966821:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135702.966823:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135702.969149:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:3.0:1789135703.566410:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135703.566431:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545050112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135703.566503:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135703.566559:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545050112 00000100:00100000:3.0:1789135703.566565:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545050112 00000100:00100000:3.0:1789135703.566606:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789135703.566629:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545050112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135703.566665:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135703.566704:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545050112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135703.566711:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789135703.566768:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41d7a940 x1876044545050112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135703.566803:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545050112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135703.759565:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135704.781103:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135705.804495:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135706.828366:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135707.148401:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135707.148422:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545050368:0@lo:400:kworker.0 00000100:00100000:3.0:1789135707.148505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135707.148585:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545050496:0@lo:400:kworker.0 00000100:00100000:3.0:1789135707.148607:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135707.148655:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135707.148661:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545050880:0@lo:400:kworker.0 00000100:00100000:3.0:1789135707.148684:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135707.148836:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545050368 00000100:00100000:2.0:1789135707.148844:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545050368 00000100:00100000:2.0:1789135707.148891:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545050496 00000100:00100000:2.0:1789135707.148894:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545050496 00000100:00100000:2.0:1789135707.148933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789135707.148941:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545050368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135707.148992:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545050368:12345-0@lo:400:kworker.0 Request processed in 52us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135707.149000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789135707.149015:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789135707.149022:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545050496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135707.149049:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545050496:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135707.149108:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789135707.149130:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545050880 00000100:00100000:2.0:1789135707.149134:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545050880 00000100:00100000:2.0:1789135707.149160:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789135707.149166:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545050880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135707.149197:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545050880:12345-0@lo:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135707.149203:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789135707.149218:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135707.149221:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789135707.149258:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d3480 x1876044545050880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135707.149271:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545050880:0@lo:400:kworker.0 00000100:00100000:2.0:1789135707.149281:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545050496:0@lo:400:kworker.0 00000100:00100000:2.0:1789135707.149288:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545050368:0@lo:400:kworker.0 00000100:00100000:0.0:1789135707.150010:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545050240:0@lo:400:kworker.0 00000100:00100000:0.0:1789135707.150051:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135707.150140:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545050752:0@lo:400:kworker.0 00000100:00100000:0.0:1789135707.150164:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135707.150185:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135707.150191:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545050624:0@lo:400:kworker.0 00000100:00100000:0.0:1789135707.150212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135707.150255:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545050624 00000100:00100000:0.0:1789135707.150260:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545050624 00000100:00100000:0.0:1789135707.150317:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135707.150325:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545050624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135707.150367:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545050624:12345-0@lo:400:kworker.0 Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135707.150385:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789135707.150405:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135707.150426:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d03c0 x1876044545050624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135707.150438:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545050624:0@lo:400:kworker.0 00000100:00100000:3.0:1789135707.151274:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545050752 00000100:00100000:3.0:1789135707.151281:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545050752 00000100:00100000:3.0:1789135707.151341:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789135707.151349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545050752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135707.151405:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545050752:12345-0@lo:400:kworker.0 Request processed in 58us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135707.151412:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789135707.152177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545050240 00000100:00100000:2.0:1789135707.152184:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545050240 00000100:00100000:2.0:1789135707.152223:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789135707.152231:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545050240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135707.152272:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545050240:12345-0@lo:400:kworker.0 Request processed in 42us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135707.152278:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1789135707.155029:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135707.155126:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545050240:0@lo:400:kworker.0 00000100:00100000:0.0:1789135707.155147:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545050752:0@lo:400:kworker.0 00000100:00100000:0.0:1789135707.661477:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135707.661501:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545051008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135707.661582:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135707.661660:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545051008 00000100:00100000:3.0:1789135707.661668:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545051008 00000100:00100000:3.0:1789135707.661721:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789135707.661730:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545051008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135707.661763:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135707.661807:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545051008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135707.661814:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789135707.661893:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d0f00 x1876044545051008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135707.661911:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545051008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789135707.852741:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135708.089238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135708.089383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135708.089417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135708.089470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135708.089503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135708.089535:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512508032 00000100:00100000:3.0:1789135708.089544:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512508032 00000100:00100000:3.0:1789135708.089587:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512508160 00000100:00100000:3.0:1789135708.089590:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512508160 00000100:00100000:3.0:1789135708.089609:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:3.0:1789135708.089617:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2374:x1876044512508032:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:3.0:1789135708.089644:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3fdf 00000100:00080000:3.0:1789135708.089652:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8adc03e02800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789135708.089688:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789135708.089768:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512507648 00000100:00100000:1.0:1789135708.089841:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512507648 00000100:00100000:1.0:1789135708.089868:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 231 00000100:00100000:1.0:1789135708.089874:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2378:x1876044512507648:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135708.089988:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+2:2374:x1876044512508032:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 370us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135708.089996:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:3.0:1789135708.090012:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:3.0:1789135708.090019:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2374:x1876044512508160:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:3.0:1789135708.090031:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3fe6 00000100:00080000:3.0:1789135708.090036:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8adc03e07000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789135708.090038:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2378:x1876044512507648:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 163us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135708.090045:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 231 00000001:00000004:3.0:1789135708.090057:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789135708.090170:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512507904 00000100:00100000:2.0:1789135708.090175:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512507904 00000100:00100000:2.0:1789135708.090214:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512507776 00000100:00100000:2.0:1789135708.090223:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512507776 00000100:00100000:2.0:1789135708.090249:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:2.0:1789135708.090255:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512507904:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135708.090257:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+2:2374:x1876044512508160:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 239us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135708.090263:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00010000:00010000:3.0:1789135708.090281:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135708.090282:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512507904:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135708.090300:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:2.0:1789135708.090313:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:2.0:1789135708.090319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512507776:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135708.090341:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512507776:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 22us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135708.090347:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00080000:0.0:1789135708.090560:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135708.090565:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135708.090566:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789135708.090935:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135708.684191:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135708.684213:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545051136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135708.684278:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135708.685193:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545051136 00000100:00100000:3.0:1789135708.685263:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545051136 00000100:00100000:3.0:1789135708.685316:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135708.685325:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545051136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135708.685355:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135708.685416:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545051136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135708.685423:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789135708.688084:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d12c0 x1876044545051136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135708.688110:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545051136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135708.879417:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135709.905136:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135710.837870:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d573bc19-f13c-42b5-94dc-b94e81618c9c 00000020:00000080:0.0:1789135710.837883:0:7637:0:(genops.c:885:class_export_put()) final put ffff8adc03e00800/d573bc19-f13c-42b5-94dc-b94e81618c9c 00000020:00000080:0.0:1789135710.837917:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc03e00800/d573bc19-f13c-42b5-94dc-b94e81618c9c for lustre-OST0001 00000020:00000080:0.0:1789135710.837977:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc03e07000 for lustre-OST0001 00010000:00010000:2.0:1789135710.926022:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135711.950111:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135712.271998:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545051648:0@lo:400:kworker.0 00000100:00100000:0.0:1789135712.272124:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135712.272206:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789135712.272214:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545051264:0@lo:400:kworker.0 00000100:00100000:0.0:1789135712.272248:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135712.272289:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545051776:0@lo:400:kworker.0 00000100:00100000:0.0:1789135712.273485:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135712.273839:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545051392:0@lo:400:kworker.0 00000100:00100000:0.0:1789135712.273881:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135712.273908:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545051904:0@lo:400:kworker.0 00000100:00100000:3.0:1789135712.274148:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545051776 00000100:00100000:3.0:1789135712.274158:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545051776 00000100:00100000:3.0:1789135712.274229:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545051392 00000100:00100000:3.0:1789135712.274232:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545051392 00000100:00100000:3.0:1789135712.274252:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789135712.274273:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545051776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135712.274482:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545051776:12345-0@lo:400:kworker.0 Request processed in 221us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135712.274491:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789135712.274526:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789135712.274534:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545051392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135712.274572:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545051392:12345-0@lo:400:kworker.0 Request processed in 38us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135712.274578:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789135712.275468:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545051520:0@lo:400:kworker.0 00000100:00100000:0.0:1789135712.276059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135712.276396:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135712.276469:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545051520 00000100:00100000:3.0:1789135712.276480:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545051520 00000100:00100000:0.0:1789135712.277041:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545051392:0@lo:400:kworker.0 00000100:00100000:0.0:1789135712.278090:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545051648 00000100:00100000:0.0:1789135712.278100:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545051648 00000100:00100000:0.0:1789135712.278173:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545051904 00000100:00100000:0.0:1789135712.278177:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545051904 00000100:00100000:0.0:1789135712.278207:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789135712.278218:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545051648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135712.278647:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789135712.278661:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545051520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135712.278768:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545051520:12345-0@lo:400:kworker.0 Request processed in 109us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135712.278792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789135712.278858:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545051520:0@lo:400:kworker.0 00000100:00100000:1.0:1789135712.280235:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545051776:0@lo:400:kworker.0 00000100:00080000:1.0:1789135712.280276:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135712.280282:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135712.280287:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135712.280874:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545051648:12345-0@lo:400:kworker.0 Request processed in 2652us (8744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135712.280888:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789135712.281575:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545051264 00000100:00100000:1.0:1789135712.281585:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545051264 00000100:00100000:0.0:1789135712.282614:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789135712.282710:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789135712.282734:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545051264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135712.282927:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545051264:12345-0@lo:400:kworker.0 Request processed in 204us (10676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135712.282936:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789135712.283040:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545051904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135712.283146:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545051264:0@lo:400:kworker.0 00010000:00080000:1.0:1789135712.283165:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d0f00 x1876044545051648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135712.283177:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545051648:0@lo:400:kworker.0 00000100:00100000:0.0:1789135712.284694:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545051904:12345-0@lo:400:kworker.0 Request processed in 2056us (8627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135712.284731:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789135712.286582:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d03c0 x1876044545051904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135712.286606:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545051904:0@lo:400:kworker.0 00000100:00100000:1.0:1789135712.780437:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135712.780462:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545052032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135712.780536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135712.780664:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545052032 00000100:00100000:2.0:1789135712.780670:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545052032 00000100:00100000:2.0:1789135712.780723:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135712.780733:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545052032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135712.780765:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135712.780806:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545052032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135712.780827:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789135712.780908:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d12c0 x1876044545052032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135712.780935:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545052032:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789135712.819607:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d573bc19-f13c-42b5-94dc-b94e81618c9c 00000020:00000080:1.0:1789135712.819615:0:6705:0:(genops.c:885:class_export_put()) final put ffff8adc03e03800/d573bc19-f13c-42b5-94dc-b94e81618c9c 00000020:00000080:3.0:1789135712.819677:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc03e03800/d573bc19-f13c-42b5-94dc-b94e81618c9c for lustre-OST0000 00000020:00000080:3.0:1789135712.819725:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc03e02800 for lustre-OST0000 00010000:00010000:1.0:1789135712.972730:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135713.209787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135713.209896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135713.210483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135713.220110:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512508288 00000100:00100000:1.0:1789135713.220125:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512508288 00000100:00100000:1.0:1789135713.220204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 233 00000100:00100000:1.0:1789135713.220216:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2378:x1876044512508288:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135713.220298:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2378:x1876044512508288:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 85us (10401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135713.220306:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 233 00000100:00100000:3.0:1789135713.222978:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512508416 00000100:00100000:3.0:1789135713.223245:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512508416 00000100:00080000:2.0:1789135713.223412:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135713.223927:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512508544 00000100:00100000:3.0:1789135713.223933:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512508544 00000100:00080000:3.0:1789135713.223956:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135713.223995:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:3.0:1789135713.224006:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512508416:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135713.224097:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512508416:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 93us (14318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135713.224106:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:3.0:1789135713.224211:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:3.0:1789135713.224219:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512508544:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135713.224251:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512508544:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 33us (13770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135713.224258:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:2.0:1789135713.804224:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135713.804244:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545052160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135713.804326:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135713.804398:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545052160 00000100:00100000:2.0:1789135713.804404:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545052160 00000100:00100000:2.0:1789135713.804443:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135713.804451:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545052160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135713.804484:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135713.804523:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545052160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135713.804529:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789135713.804564:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ecb40 x1876044545052160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135713.804579:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545052160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135713.996209:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135714.152039:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789135715.020355:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135716.050838:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135717.069801:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135717.389226:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545052416:0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.389303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135717.389361:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545052928:0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.389387:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135717.389430:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135717.389437:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545052544:0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.389473:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135717.389510:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545052416 00000100:00100000:3.0:1789135717.389517:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545052416 00000100:00100000:3.0:1789135717.389554:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545052544 00000100:00100000:3.0:1789135717.389558:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545052544 00000100:00100000:3.0:1789135717.389586:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789135717.389594:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545052416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.389641:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545052416:12345-0@lo:400:kworker.0 Request processed in 48us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135717.389649:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789135717.389664:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789135717.389670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545052544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.389696:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545052544:12345-0@lo:400:kworker.0 Request processed in 26us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135717.389702:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789135717.389719:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545052928 00000100:00100000:3.0:1789135717.389722:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545052928 00000100:00100000:3.0:1789135717.389749:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789135717.389755:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545052928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.390384:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545052928:12345-0@lo:400:kworker.0 Request processed in 628us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135717.390392:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789135717.390418:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135717.390422:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135717.390453:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545052544:0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.390474:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545052416:0@lo:400:kworker.0 00010000:00080000:3.0:1789135717.390486:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d2d00 x1876044545052928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135717.390495:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545052928:0@lo:400:kworker.0 00000100:00100000:2.0:1789135717.390580:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545052288:0@lo:400:kworker.0 00000100:00100000:2.0:1789135717.390613:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135717.390646:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545052800:0@lo:400:kworker.0 00000100:00100000:2.0:1789135717.390667:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135717.390691:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135717.390697:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545052672:0@lo:400:kworker.0 00000100:00100000:2.0:1789135717.390719:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135717.390745:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545052672 00000100:00100000:2.0:1789135717.390749:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545052672 00000100:00100000:2.0:1789135717.390796:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789135717.390803:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545052672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135717.390838:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545052672:12345-0@lo:400:kworker.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135717.390845:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1789135717.390886:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d03c0 x1876044545052672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135717.390897:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545052672:0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.391112:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545052288 00000100:00100000:3.0:1789135717.391117:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545052288 00000100:00100000:3.0:1789135717.391145:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789135717.391152:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545052288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.391194:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545052288:12345-0@lo:400:kworker.0 Request processed in 42us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135717.391200:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:3.0:1789135717.391223:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135717.391232:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545052800 00000100:00100000:3.0:1789135717.391235:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545052800 00000100:00100000:3.0:1789135717.391441:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789135717.391451:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545052800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.391484:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545052800:12345-0@lo:400:kworker.0 Request processed in 36us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135717.391490:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1789135717.391506:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135717.391522:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545052288:0@lo:400:kworker.0 00000100:00100000:3.0:1789135717.391532:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545052800:0@lo:400:kworker.0 00000100:00100000:2.0:1789135717.902233:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135717.902257:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545053056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135717.902335:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135717.905555:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545053056 00000100:00100000:3.0:1789135717.905568:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545053056 00000100:00100000:3.0:1789135717.905636:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789135717.905659:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545053056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135717.905708:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135717.905804:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545053056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (3469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135717.905811:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789135717.905948:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bf8000 x1876044545053056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135717.905969:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545053056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135718.094086:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135718.325369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135718.325408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135718.325429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135718.325453:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512508672 00000100:00100000:3.0:1789135718.325462:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512508672 00000100:00100000:3.0:1789135718.325504:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 235 00000100:00100000:3.0:1789135718.325512:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2378:x1876044512508672:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135718.325569:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2378:x1876044512508672:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.325576:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 235 00000100:00100000:3.0:1789135718.325605:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512508928 00000100:00100000:3.0:1789135718.325608:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512508928 00000100:00100000:3.0:1789135718.325639:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512508800 00000100:00100000:3.0:1789135718.325642:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512508800 00000100:00100000:3.0:1789135718.325662:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:3.0:1789135718.325669:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512508928:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135718.325699:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512508928:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.325705:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:3.0:1789135718.325716:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 104 00000100:00100000:3.0:1789135718.325721:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512508800:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135718.325775:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512508800:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 53us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.325782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 104 00000100:00080000:3.0:1789135718.325898:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1789135718.759498:0:11161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc309f31a0 20000000:00000080:1.0:1789135718.759513:0:11161:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc348c6400 uarg=0000000000000000 20000000:01000000:1.0:1789135718.759544:0:11161:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789135718.759549:0:11161:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789135718.759558:0:11161:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789135718.760369:0:11162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789135718.760511:0:11161:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789135718.768775:0:11161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789135718.768798:0:11161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.768817:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.768827:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.768843:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.768850:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.768858:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.768865:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.768907:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.768921:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 12 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.768934:0:11161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3021c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053184:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135718.769050:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.769086:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 18 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.769097:0:11161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a303c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053312:0@lo:104: 00000100:00100000:1.0:1789135718.769132:0:11161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135718.769160:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.769168:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 18 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.769176:0:11161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3030c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053440:0@lo:104: 00000100:00100000:1.0:1789135718.769193:0:11161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135718.769210:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.769218:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 18 pid: 5832 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.769226:0:11161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a302d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053568:0@lo:104: 00000100:00100000:1.0:1789135718.769244:0:11161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135718.769261:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.769269:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 12 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.769290:0:11161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a300780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053696:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135718.769329:0:11161:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135718.769433:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545053312 00000100:00100000:3.0:1789135718.769439:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545053312 00000100:00100000:3.0:1789135718.769470:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545053440 00000100:00100000:3.0:1789135718.769472:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545053440 00000100:00100000:3.0:1789135718.769480:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545053568 00000100:00100000:3.0:1789135718.769482:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545053568 00000100:00100000:3.0:1789135718.769492:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789135718.769499:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+5:11161:x1876044545053312:12345-0@lo:104: 00010000:00010000:3.0:1789135718.769511:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769573:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135718.769579:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+5:11161:x1876044545053312:12345-0@lo:104: Request processed in 80us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.769585:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789135718.769599:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789135718.769605:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:11161:x1876044545053440:12345-0@lo:104: 00010000:00010000:3.0:1789135718.769612:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769638:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789135718.769642:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:11161:x1876044545053440:12345-0@lo:104: Request processed in 39us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.769648:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789135718.769665:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789135718.769670:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:11161:x1876044545053568:12345-0@lo:104: 00010000:00010000:3.0:1789135718.769677:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769707:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789135718.769712:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:11161:x1876044545053568:12345-0@lo:104: Request processed in 42us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.769718:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789135718.769733:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789135718.769738:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769746:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab600 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135718.769750:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769758:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135718.769766:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135718.769772:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135718.769793:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769799:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135718.769813:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769831:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc34bab600/0x5b09da6ee1ce3fb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769842:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135718.769846:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769851:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab200 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135718.769854:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769861:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135718.769867:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135718.769873:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135718.769895:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769901:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135718.769907:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769914:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc34bab200/0x5b09da6ee1ce3fa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769921:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135718.769929:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769935:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc029e5a00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135718.769938:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769944:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135718.769950:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135718.769956:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135718.769966:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769972:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135718.769982:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.769988:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc029e5a00/0x5b09da6ee1ce3f99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.770000:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135718.770002:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135718.770003:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135718.770014:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545053952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135718.770043:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.770091:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135718.770097:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545053824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135718.770123:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.770152:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545053952 00000100:00100000:3.0:1789135718.770155:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545053952 00010000:00010000:3.0:1789135718.770171:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 19 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.770191:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545053824 00000100:00100000:3.0:1789135718.770194:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545053824 00010000:00010000:3.0:1789135718.770203:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 20 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.770217:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135718.770223:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05777c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+20:3316:x1876044545053952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135718.770232:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135718.770237:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 20 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.770245:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 20 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.770259:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135718.770285:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05777c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+20:3316:x1876044545053952:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.770292:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135718.770336:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789135718.770341:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545053824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135718.770348:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135718.770352:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 19 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.770370:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 19 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.770380:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135718.770400:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545053824:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.770407:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789135718.770443:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545053824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135718.770450:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545053952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135718.770937:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135718.770943:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135718.770960:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545054080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135718.770988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135718.771332:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce3fbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fb5 expref: 18 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.771345:0:11161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a303c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053312:0@lo:104: 00010000:00010000:1.0:1789135718.771355:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e5800/0x5b09da6ee1ce3fae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3fa7 expref: 17 pid: 5830 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.771363:0:11161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3030c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053440:0@lo:104: 00000100:00100000:1.0:1789135718.771370:0:11161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a302d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053568:0@lo:104: 00000100:00100000:3.0:1789135718.771618:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545054080 00000100:00100000:3.0:1789135718.771623:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545054080 00010000:00010000:3.0:1789135718.771644:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 17 pid: 5832 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.771682:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789135718.771689:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+17:3313:x1876044545054080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135718.771698:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135718.771702:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 17 pid: 5832 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.771711:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 17 pid: 5832 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.771725:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e4200/0x5b09da6ee1ce3fa0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3f99 expref: 17 pid: 5832 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.771735:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135718.771785:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+16:3313:x1876044545054080:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.771792:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135718.772431:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545054080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135718.777110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135718.777137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135718.777202:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512509056 00000100:00100000:1.0:1789135718.777209:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512509056 00010000:00010000:1.0:1789135718.777241:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 13 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.777269:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512509184 00000100:00100000:1.0:1789135718.777272:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512509184 00010000:00010000:1.0:1789135718.777285:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135718.777304:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:1.0:1789135718.777323:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c10fadf3-edc6-4c88-b194-561a01ca971d+14:2375:x1876044512509056:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135718.777349:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135718.777355:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777367:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777385:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135718.777425:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c10fadf3-edc6-4c88-b194-561a01ca971d+14:2375:x1876044512509056:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 103us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.777432:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:1.0:1789135718.777457:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:1.0:1789135718.777463:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512509184:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135718.777470:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135718.777474:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 13 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777483:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 13 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777494:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777502:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777516:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777533:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777540:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777547:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777553:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baba00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135718.777557:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777577:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777586:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.777597:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135718.777615:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512509184:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 151us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.777621:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00010000:00010000:2.0:1789135718.778712:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce3fd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34cb expref: 12 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135718.778738:0:11161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3021c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053184:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135718.778751:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb3a00/0x5b09da6ee1ce3f92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3493 expref: 11 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135718.778760:0:11161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a300780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876044545053696:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135718.778791:0:11161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.778813:0:11161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.778820:0:11161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.778827:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce3fed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.934238:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135718.934261:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545054208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135718.934331:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135718.934431:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545054208 00000100:00100000:2.0:1789135718.934437:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545054208 00000100:00100000:2.0:1789135718.934485:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789135718.934494:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545054208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135718.934524:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135718.934574:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545054208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135718.934582:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789135718.934704:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ef0c0 x1876044545054208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135718.934722:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545054208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135719.116278:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135720.076571:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135720.076578:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adb01c80000 from 7 10000000:01000000:1.0:1789135720.076582:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135720.076624:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.076635:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.076655:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135720.076680:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a303840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.076744:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135720.076790:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04649c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135720.076918:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545054336 00000100:00100000:2.0:1789135720.076926:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545054336 00000100:00100000:2.0:1789135720.076973:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789135720.076982:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545054336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135720.076995:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135720.077008:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce3ff4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135720.077030:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135720.077054:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135720.077166:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3e00, rc 0) 00000100:00100000:2.0:1789135720.077214:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545054336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135720.077221:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789135720.077523:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a303840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135720.077540:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135720.077551:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135720.077609:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135720.077641:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135720.077678:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1374c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135720.077751:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545054464 00000100:00100000:1.0:1789135720.077756:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545054464 00000100:00100000:1.0:1789135720.077788:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789135720.077795:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545054464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.078321:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545054464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 524us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135720.078334:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789135720.078499:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135720.078543:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135720.078581:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135720.078724:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1374c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135720.078757:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545054592 00000100:00100000:1.0:1789135720.078762:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545054592 00000100:00100000:1.0:1789135720.078821:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789135720.078828:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545054592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.078966:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545054592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135720.078973:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789135720.079200:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789135720.079910:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789135720.079959:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789135720.079975:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135720.079983:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135720.079994:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135720.080003:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135720.080006:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc057f3800 from 7 10000000:01000000:0.0:1789135720.080009:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135720.080037:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135720.080045:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135720.080053:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135720.080443:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135720.080487:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135720.080550:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135720.080729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545054720 00000100:00100000:1.0:1789135720.080735:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545054720 00000100:00100000:1.0:1789135720.080802:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789135720.080810:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545054720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135720.080823:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135720.080841:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce4002 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.080862:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.080873:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.080880:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34baac00, rc 0) 00000100:00100000:1.0:1789135720.080926:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545054720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135720.080933:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789135720.081034:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135720.081050:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135720.081059:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135720.081146:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ecb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135720.081175:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135720.081200:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13e9a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135720.081758:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545054848 00000100:00100000:1.0:1789135720.081765:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545054848 00000100:00100000:1.0:1789135720.081927:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789135720.081937:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545054848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.082206:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545054848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135720.082214:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789135720.087571:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ecb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.087628:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a300780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.087697:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135720.088296:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135720.089011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545054976 00000100:00100000:2.0:1789135720.089021:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545054976 00000100:00100000:2.0:1789135720.089089:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789135720.089099:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545054976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135720.089323:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545054976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135720.089330:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789135720.090184:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a300780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545054976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789135720.092841:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789135720.093055:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789135720.093102:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135720.093113:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135720.093124:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135720.093134:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135720.093137:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc10b30000 from 7 10000000:01000000:3.0:1789135720.093139:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135720.093173:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135720.093181:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135720.093191:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135720.093227:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545055104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135720.093287:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135720.093333:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41926180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135720.095150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545055104 00000100:00100000:1.0:1789135720.095162:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545055104 00000100:00100000:1.0:1789135720.095208:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789135720.095218:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545055104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135720.095242:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135720.095258:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce4010 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.095282:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.095292:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.095309:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34baaa00, rc 0) 00000100:00100000:3.0:1789135720.096621:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545055104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135720.096654:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135720.096666:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135720.096735:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545055232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.098342:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545055104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3119us (5049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135720.098353:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789135720.098395:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135720.098436:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41926180 going to sleep for 11 seconds 00000100:00100000:3.0:1789135720.098455:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545055232 00000100:00100000:3.0:1789135720.098461:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545055232 00000100:00100000:3.0:1789135720.098492:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789135720.098500:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545055232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135720.098992:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545055232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 491us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135720.099000:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789135720.099520:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545055232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.099570:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3021c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545055360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135720.099613:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135720.099642:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135720.099741:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545055360 00000100:00100000:3.0:1789135720.099746:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545055360 00000100:00100000:3.0:1789135720.099783:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789135720.099790:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545055360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135720.099941:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545055360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135720.099954:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789135720.100115:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3021c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545055360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789135720.102671:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789135720.102923:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789135720.102940:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135720.102951:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135720.102962:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135720.141369:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135720.694115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135720.694212:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512509312 00000100:00100000:2.0:1789135720.694222:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512509312 00000100:00100000:2.0:1789135720.694276:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 245 00000100:00100000:2.0:1789135720.694286:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+11:5620:x1876044512509312:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135720.694312:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135720.694328:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d34f5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135720.694354:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135720.694364:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135720.694373:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2600, rc 0) 00000100:00100000:2.0:1789135720.694423:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512509312:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 139us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135720.694429:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 245 00000100:00100000:2.0:1789135720.702475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135720.702590:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512509440 00000100:00100000:0.0:1789135720.702599:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512509440 00000100:00100000:0.0:1789135720.702685:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 246 00000100:00100000:0.0:1789135720.702695:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512509440:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135720.703329:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512509440:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 633us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135720.703338:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 246 00000100:00100000:1.0:1789135720.712149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135720.716782:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512509568 00000100:00100000:0.0:1789135720.716799:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512509568 00000100:00100000:2.0:1789135720.720240:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 247 00000100:00100000:2.0:1789135720.720254:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512509568:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135720.720474:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512509568:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 223us (8334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135720.720482:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 247 00000100:00100000:1.0:1789135720.742369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135720.742484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512509696 00000100:00100000:0.0:1789135720.742494:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512509696 00000100:00100000:0.0:1789135720.742567:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 248 00000100:00100000:0.0:1789135720.742577:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512509696:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135720.742592:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135720.742608:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d34fc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135720.742636:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135720.742646:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135720.742656:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030800, rc 0) 00000100:00100000:0.0:1789135720.742708:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512509696:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 133us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135720.742716:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 248 00000100:00100000:1.0:1789135720.752558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135720.752733:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512509824 00000100:00100000:3.0:1789135720.752742:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512509824 00000100:00100000:3.0:1789135720.752785:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 249 00000100:00100000:3.0:1789135720.752793:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512509824:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135720.753292:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512509824:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 497us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135720.753311:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 249 00000100:00100000:1.0:1789135720.759279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135720.759387:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512509952 00000100:00100000:0.0:1789135720.759396:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512509952 00000100:00100000:0.0:1789135720.759446:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 250 00000100:00100000:0.0:1789135720.759454:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512509952:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135720.759662:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512509952:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 209us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135720.759670:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 250 00010000:00010000:0.0:1789135721.164672:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135722.189113:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135722.512249:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545055488:0@lo:400:kworker.0 00000100:00100000:1.0:1789135722.512335:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135722.512550:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135722.512557:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545055616:0@lo:400:kworker.0 00000100:00100000:1.0:1789135722.512586:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135722.512619:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545055616 00000100:00100000:1.0:1789135722.512625:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545055488 00000100:00100000:0.0:1789135722.512627:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545055616 00000100:00100000:1.0:1789135722.512631:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545055488 00000100:00100000:1.0:1789135722.512681:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789135722.512686:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789135722.512693:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545055488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135722.512700:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545055616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135722.512757:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545055488:12345-0@lo:400:kworker.0 Request processed in 66us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135722.512760:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545055616:12345-0@lo:400:kworker.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135722.512770:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789135722.512774:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789135722.512835:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545055616:0@lo:400:kworker.0 00000100:00100000:1.0:1789135722.512845:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545055488:0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.515474:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545056128:0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.515543:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135722.515580:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135722.515586:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545056000:0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.515613:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135722.515641:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545055872:0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.515664:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135722.515683:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135722.515689:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545055744:0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.515709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135722.515742:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545056128 00000100:00100000:2.0:1789135722.515748:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545056128 00000100:00080000:0.0:1789135722.515796:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135722.515810:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545055872 00000100:00100000:2.0:1789135722.515814:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545055872 00000100:00100000:2.0:1789135722.515851:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789135722.515860:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135722.515861:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545056128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.515921:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545056128:12345-0@lo:400:kworker.0 Request processed in 62us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135722.515927:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135722.515944:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789135722.515950:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545055872:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789135722.515988:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ed680 x1876044545056128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135722.516003:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545056128:0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.516446:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545055872:12345-0@lo:400:kworker.0 Request processed in 496us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135722.516454:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789135722.516474:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545056000 00000100:00100000:2.0:1789135722.516479:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545056000 00010000:00080000:0.0:1789135722.516497:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ee1c0 x1876044545055872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135722.516509:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545055872:0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.516511:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545055744 00000100:00100000:2.0:1789135722.516516:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545055744 00000100:00100000:2.0:1789135722.516554:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789135722.516561:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545056000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.516600:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545056000:12345-0@lo:400:kworker.0 Request processed in 40us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135722.516606:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789135722.516618:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789135722.516624:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545055744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.516660:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545055744:12345-0@lo:400:kworker.0 Request processed in 36us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135722.516666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1789135722.516697:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135722.516715:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545055744:0@lo:400:kworker.0 00000100:00100000:2.0:1789135722.516738:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545056000:0@lo:400:kworker.0 00000100:00100000:3.0:1789135723.026756:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545056256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135723.026815:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135723.026936:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545056256 00000100:00100000:3.0:1789135723.026941:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545056256 00000100:00100000:3.0:1789135723.026978:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135723.026985:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545056256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135723.027014:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135723.027049:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545056256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135723.027055:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789135723.027109:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bf8f00 x1876044545056256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135723.027126:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545056256:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789135723.119468:0:11361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789135723.219831:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135723.444617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135723.444835:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135723.444868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135723.445036:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512510336 00000100:00100000:2.0:1789135723.445045:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512510336 00000100:00100000:2.0:1789135723.445130:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512510208 00000100:00100000:2.0:1789135723.445134:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512510208 00000100:00100000:2.0:1789135723.445155:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 108 00000100:00100000:2.0:1789135723.445164:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512510336:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135723.445249:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512510336:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 76us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135723.445257:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 108 00000100:00100000:2.0:1789135723.445273:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 109 00000100:00100000:2.0:1789135723.445289:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512510208:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135723.445328:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a303c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2377:x1876044512510208:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 48us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135723.445334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 109 00000100:00080000:1.0:1789135723.445666:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135723.446829:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512510080 00000100:00100000:3.0:1789135723.446850:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512510080 00000100:00100000:3.0:1789135723.446995:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 252 00000100:00100000:3.0:1789135723.447005:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512510080:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135723.447097:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512510080:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 94us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135723.447105:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 252 00000100:00100000:0.0:1789135724.044590:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135724.050698:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545056384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135724.050793:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135724.052375:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545056384 00000100:00100000:3.0:1789135724.052388:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545056384 00000100:00100000:3.0:1789135724.052616:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789135724.052628:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545056384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135724.052669:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135724.052754:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545056384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135724.052762:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789135724.053935:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ec000 x1876044545056384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135724.053959:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545056384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789135724.060048:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789135724.246051:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135725.260616:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135726.288277:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135727.311140:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135727.629271:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545056640:0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.629342:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135727.629508:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545057152:0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.629688:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135727.629720:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789135727.629726:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545056512:0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.629754:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135727.629775:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545057024:0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.629797:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135727.629824:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545056768:0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.633417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135727.633485:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135727.633497:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545056896:0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.633782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135727.633832:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545056640 00000100:00100000:2.0:1789135727.633838:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545056640 00000100:00100000:1.0:1789135727.634216:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545057152 00000100:00100000:1.0:1789135727.634222:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545057152 00000100:00100000:1.0:1789135727.634293:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545056896 00000100:00100000:1.0:1789135727.634297:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545056896 00000100:00100000:1.0:1789135727.634321:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789135727.634330:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545057152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135727.634622:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545057152:12345-0@lo:400:kworker.0 Request processed in 292us (4933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135727.634631:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789135727.634662:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789135727.634668:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41908780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545056896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.635506:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545057024 00000100:00100000:1.0:1789135727.636056:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41908780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545056896:12345-0@lo:400:kworker.0 Request processed in 1384us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135727.636078:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789135727.636121:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135727.636125:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789135727.636166:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346ed680 x1876044545056896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135727.636181:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545056896:0@lo:400:kworker.0 00010000:00080000:1.0:1789135727.636227:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346e9e00 x1876044545057152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135727.636237:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545057152:0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.636604:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545057024 00000100:00100000:2.0:1789135727.636648:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545056768 00000100:00100000:2.0:1789135727.636664:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545056768 00000100:00100000:2.0:1789135727.636686:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789135727.636694:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545056640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.636761:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545056640:12345-0@lo:400:kworker.0 Request processed in 68us (7418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135727.636767:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789135727.636781:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789135727.636787:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545057024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.636814:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545057024:12345-0@lo:400:kworker.0 Request processed in 28us (7016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135727.636820:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789135727.636831:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789135727.638127:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545057024:0@lo:400:kworker.0 00000100:00100000:1.0:1789135727.638143:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545056640:0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.638677:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545056768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135727.638771:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545056768:12345-0@lo:400:kworker.0 Request processed in 1934us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135727.638781:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789135727.638823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545056512 00000100:00100000:2.0:1789135727.638830:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545056512 00000100:00100000:1.0:1789135727.639508:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545056768:0@lo:400:kworker.0 00000100:00100000:1.0:1789135727.641736:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789135727.641753:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545056512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135727.641837:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545056512:12345-0@lo:400:kworker.0 Request processed in 90us (12082us total) trans 0 rc 0/0 00000100:00080000:2.0:1789135727.641975:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135727.643208:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789135727.643720:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545056512:0@lo:400:kworker.0 00000100:00100000:1.0:1789135728.143058:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545057280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135728.143169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135728.145206:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545057280 00000100:00100000:3.0:1789135728.145219:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545057280 00000100:00100000:3.0:1789135728.145293:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789135728.145303:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545057280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135728.145340:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135728.145426:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545057280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135728.145433:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789135728.145570:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bf8f00 x1876044545057280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135728.145592:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545057280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789135728.337995:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135728.566463:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135728.566507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135728.566541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135728.566567:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512510592 00000100:00100000:1.0:1789135728.566575:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512510592 00000100:00100000:1.0:1789135728.566625:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512510720 00000100:00100000:1.0:1789135728.566628:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512510720 00000100:00100000:1.0:1789135728.566649:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:1.0:1789135728.566658:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512510592:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135728.566724:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512510592:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135728.566731:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:1.0:1789135728.566758:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:1.0:1789135728.566773:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512510720:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135728.566800:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512510720:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135728.566806:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00080000:1.0:1789135728.566824:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135728.567226:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512510464 00000100:00100000:0.0:1789135728.567232:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512510464 00000100:00100000:0.0:1789135728.567281:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 254 00000100:00100000:0.0:1789135728.567288:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512510464:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135728.567317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512510464:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135728.567324:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 254 00000020:00000080:3.0:1789135728.606349:0:11606:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb73a37a0 20000000:00000080:3.0:1789135728.606363:0:11606:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc41db7400 uarg=0000000000000000 20000000:01000000:3.0:1789135728.606398:0:11606:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789135728.606409:0:11606:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789135728.606414:0:11606:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789135728.610654:0:11607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789135728.611334:0:11606:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789135728.618444:0:11606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789135728.618496:0:11606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:0.0:1789135728.618563:0:11606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:0.0:1789135728.618579:0:11606:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789135728.618595:0:11606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618612:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618621:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618628:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618637:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618655:0:11606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618662:0:11606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618694:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618709:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 12 pid: 5830 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.618724:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545057408:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135728.618939:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618948:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 12 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.618957:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545057536:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135728.618985:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.618993:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 18 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.619002:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545057664:0@lo:104: 00000100:00100000:0.0:1789135728.619034:0:11606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135728.619104:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619113:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 18 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.619121:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545057792:0@lo:104: 00000100:00100000:0.0:1789135728.619140:0:11606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135728.619169:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545057664 00000100:00100000:0.0:1789135728.619176:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545057664 00000100:00100000:0.0:1789135728.619207:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545057792 00000100:00100000:0.0:1789135728.619209:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545057792 00000100:00100000:0.0:1789135728.619221:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135728.619228:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:11606:x1876044545057664:12345-0@lo:104: 00010000:00010000:0.0:1789135728.619240:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619293:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135728.619299:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:11606:x1876044545057664:12345-0@lo:104: Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135728.619305:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135728.619320:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135728.619326:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:11606:x1876044545057792:12345-0@lo:104: 00010000:00010000:0.0:1789135728.619334:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619363:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789135728.619367:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:11606:x1876044545057792:12345-0@lo:104: Request processed in 42us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135728.619382:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789135728.619399:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135728.619404:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619411:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:0.0:1789135728.619414:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619422:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135728.619428:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135728.619434:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789135728.619455:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619461:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135728.619480:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619485:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e000/0x5b09da6ee1ce4010 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4017 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619497:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135728.619500:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619515:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031600 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:0.0:1789135728.619518:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619524:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135728.619531:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135728.619536:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789135728.619550:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619556:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135728.619567:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619573:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc00031600/0x5b09da6ee1ce4002 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4009 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619583:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135728.619584:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135728.619586:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135728.619605:0:11606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619613:0:11606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 18 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.619632:0:11606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3570c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545058176:0@lo:104: 00000100:00100000:0.0:1789135728.619658:0:11606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135728.619684:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789135728.619692:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545058176 00000100:00100000:0.0:1789135728.619695:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545058176 00000100:00100000:0.0:1789135728.619711:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135728.619716:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:11606:x1876044545058176:12345-0@lo:104: 00010000:00010000:0.0:1789135728.619723:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619755:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135728.619760:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:11606:x1876044545058176:12345-0@lo:104: Request processed in 44us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135728.619765:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789135728.619795:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135728.619799:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619805:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:0.0:1789135728.619808:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.619815:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135728.619821:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135728.620095:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135728.620111:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135728.620123:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545057920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135728.620156:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135728.620191:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545058048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135728.620212:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135728.620241:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545057920 00000100:00100000:1.0:1789135728.620245:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545057920 00010000:00010000:1.0:1789135728.620274:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 19 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135728.620293:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545058048 00000100:00100000:1.0:1789135728.620296:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545058048 00010000:00010000:1.0:1789135728.620307:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 20 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135728.620324:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135728.620330:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+20:3313:x1876044545057920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135728.620340:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135728.620344:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 20 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135728.620353:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 20 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135728.620374:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135728.620402:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+20:3313:x1876044545057920:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135728.620409:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135728.620436:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135728.620442:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545058048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135728.620449:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135728.620454:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 19 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135728.620463:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 19 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135728.620472:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135728.620497:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545058048:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135728.620503:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135728.620559:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545058048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135728.620583:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545057920:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789135728.625366:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789135728.625425:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.625432:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135728.625451:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.625459:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce3ff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce3ffb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.625480:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135728.625482:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135728.625485:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135728.625754:0:11606:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeb000 going to sleep for 11 seconds 00010000:00010000:0.0:1789135728.625788:0:11606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34baaa00/0x5b09da6ee1ce4017 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce4010 expref: 18 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.625800:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545057664:0@lo:104: 00010000:00010000:0.0:1789135728.625818:0:11606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4009 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce4002 expref: 17 pid: 5831 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.625827:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545057792:0@lo:104: 00000100:00100000:0.0:1789135728.625944:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3570c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545058176:0@lo:104: 00000100:00100000:1.0:1789135728.626339:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545058304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135728.626402:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135728.626597:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545058304 00000100:00100000:0.0:1789135728.626603:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545058304 00010000:00010000:0.0:1789135728.626633:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 17 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.626677:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135728.626685:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05774450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+17:3316:x1876044545058304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135728.626698:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135728.626703:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 17 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.626712:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 17 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.626727:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb3e00/0x5b09da6ee1ce3ffb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce3ff4 expref: 17 pid: 5832 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.626740:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135728.626953:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05774450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+16:3316:x1876044545058304:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135728.626960:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789135728.631741:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545058304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135728.638634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135728.638658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135728.638730:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512510976 00000100:00100000:3.0:1789135728.638738:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512510976 00010000:00010000:3.0:1789135728.638772:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 13 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135728.638803:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512510848 00000100:00100000:3.0:1789135728.638806:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512510848 00010000:00010000:3.0:1789135728.638822:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 14 pid: 5830 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135728.638846:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:3.0:1789135728.638853:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+14:2375:x1876044512510976:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135728.638866:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135728.638871:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 14 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.638881:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 14 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.638900:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135728.638952:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+14:2375:x1876044512510976:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 99us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135728.638960:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:3.0:1789135728.638975:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:3.0:1789135728.638994:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2375:x1876044512510848:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135728.639000:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135728.639004:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 13 pid: 5830 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639012:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 13 pid: 5830 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639024:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639032:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639045:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639051:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639057:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639086:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639092:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135728.639095:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639103:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639119:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135728.639129:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135728.639148:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2375:x1876044512510848:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 155us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135728.639155:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00010000:00010000:0.0:1789135728.639370:0:11606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4025 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34fc expref: 12 pid: 5830 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.639385:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545057408:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135728.639396:0:11606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2600/0x5b09da6ee1ce401e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34f5 expref: 11 pid: 5832 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135728.639404:0:11606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11606:1876044545057536:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135728.639431:0:11606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.639450:0:11606:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.639457:0:11606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135728.639463:0:11606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031800/0x5b09da6ee1ce402c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135729.165325:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545058432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135729.165393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135729.165512:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545058432 00000100:00100000:2.0:1789135729.165520:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545058432 00000100:00100000:2.0:1789135729.165580:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789135729.165588:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545058432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135729.165617:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135729.165654:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545058432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135729.165661:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789135729.165769:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135729.165796:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc4190a940 x1876044545058432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135729.165812:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545058432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135729.357466:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135730.290994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135730.291108:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512511104 00000100:00100000:1.0:1789135730.291118:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512511104 00000100:00100000:1.0:1789135730.291177:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 255 00000100:00100000:1.0:1789135730.291187:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+11:5620:x1876044512511104:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135730.291204:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135730.291222:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3503 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135730.291255:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135730.291265:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135730.291275:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab400, rc 0) 00000100:00100000:1.0:1789135730.291334:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512511104:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 148us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135730.291341:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 255 00000100:00100000:1.0:1789135730.293755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135730.294033:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512511232 00000100:00100000:0.0:1789135730.294042:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512511232 00000100:00100000:0.0:1789135730.294120:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 256 00000100:00100000:0.0:1789135730.294131:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512511232:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135730.294404:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512511232:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 273us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135730.294412:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 256 00000100:00100000:3.0:1789135730.296338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135730.296428:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512511360 00000100:00100000:1.0:1789135730.296449:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512511360 00000100:00100000:1.0:1789135730.296507:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 257 00000100:00100000:1.0:1789135730.296517:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512511360:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135730.296724:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512511360:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 208us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135730.296732:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 257 00000100:00100000:2.0:1789135730.300377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135730.301142:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512511488 00000100:00100000:1.0:1789135730.301151:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512511488 00000100:00100000:1.0:1789135730.301204:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 258 00000100:00100000:1.0:1789135730.301214:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:9577:x1876044512511488:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135730.301543:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:9577:x1876044512511488:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 329us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135730.301551:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 258 00000100:00100000:3.0:1789135730.309954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135730.310038:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512511616 00000100:00100000:0.0:1789135730.310047:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512511616 00000100:00100000:0.0:1789135730.310124:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 259 00000100:00100000:0.0:1789135730.310135:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:9577:x1876044512511616:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135730.332487:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:9577:x1876044512511616:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 22339us (22525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135730.335577:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 259 00000100:00100000:2.0:1789135730.344361:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135730.344457:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512511744 00000100:00100000:0.0:1789135730.344464:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512511744 00000100:00100000:0.0:1789135730.344525:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 260 00000100:00100000:0.0:1789135730.344535:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512511744:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135730.344550:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135730.344567:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d350a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135730.344594:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135730.344603:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135730.344680:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031400, rc 0) 00000100:00100000:0.0:1789135730.344744:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512511744:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 210us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135730.344752:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 260 00000100:00100000:2.0:1789135730.351283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135730.351397:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512511872 00000100:00100000:0.0:1789135730.351407:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512511872 00000100:00100000:0.0:1789135730.351470:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 261 00000100:00100000:0.0:1789135730.351481:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512511872:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135730.351754:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512511872:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 275us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135730.351763:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 261 00000100:00100000:1.0:1789135730.354168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135730.354300:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512512000 00000100:00100000:2.0:1789135730.354309:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512512000 00000100:00100000:2.0:1789135730.354352:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 262 00000100:00100000:2.0:1789135730.354360:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512512000:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.354576:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512512000:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 215us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135730.354585:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 262 00000100:00100000:1.0:1789135730.364164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135730.364422:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512512128 00000100:00100000:2.0:1789135730.364432:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512512128 00000100:00100000:2.0:1789135730.364489:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 263 00000100:00100000:2.0:1789135730.364500:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:9580:x1876044512512128:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135730.364756:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:9580:x1876044512512128:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 256us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135730.364763:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 263 00010000:00010000:3.0:1789135730.382404:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135730.383113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135730.383235:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512512256 00000100:00100000:3.0:1789135730.383253:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512512256 00000100:00100000:3.0:1789135730.383306:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 264 00000100:00100000:3.0:1789135730.383315:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:9580:x1876044512512256:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135730.383561:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:9580:x1876044512512256:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 246us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135730.383569:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 264 10000000:01000000:2.0:1789135730.385724:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789135730.385731:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adb01c80000 from 7 10000000:01000000:2.0:1789135730.385736:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135730.385776:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.385787:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.385797:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135730.385849:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545058560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.386430:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.386501:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135730.386592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545058560 00000100:00100000:0.0:1789135730.386600:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545058560 00000100:00100000:0.0:1789135730.386714:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789135730.386723:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545058560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135730.386747:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135730.386761:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce4041 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135730.386784:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135730.386795:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135730.386813:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030800, rc 0) 00000100:00100000:0.0:1789135730.386869:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545058560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135730.386876:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789135730.387204:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545058560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135730.387219:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.387228:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135730.387294:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545058688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.387324:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.387354:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135730.388768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545058688 00000100:00100000:0.0:1789135730.388780:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545058688 00000100:00100000:0.0:1789135730.388852:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789135730.388861:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545058688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135730.389180:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545058688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135730.389188:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789135730.394496:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545058688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.394561:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545058816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.394647:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.394690:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135730.394815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545058816 00000100:00100000:3.0:1789135730.394829:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545058816 00000100:00100000:3.0:1789135730.394882:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789135730.394892:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545058816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135730.395126:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545058816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135730.395134:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789135730.395349:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545058816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.396365:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11667:1876044545058944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135730.396427:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.396466:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135730.396529:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545058944 00000100:00100000:3.0:1789135730.396534:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545058944 00000100:00100000:3.0:1789135730.396577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789135730.396584:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:11667:x1876044545058944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135730.396783:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:11667:x1876044545058944:12345-0@lo:502:llog_process_th.0 Request processed in 198us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135730.396791:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789135730.397126:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41908000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11667:1876044545058944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135730.397155:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135730.397163:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135730.397166:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789135730.397172:0:11667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adb01c80000 00000020:00000080:0.0:1789135730.397174:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789135730.397265:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11667:1876044545059072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135730.397305:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135730.397338:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c84c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135730.397402:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545059072 00000100:00100000:1.0:1789135730.397407:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545059072 00000100:00100000:1.0:1789135730.397443:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789135730.397450:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:11667:x1876044545059072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135730.397584:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:11667:x1876044545059072:12345-0@lo:502:llog_process_th.0 Request processed in 134us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135730.397591:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789135730.397740:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11667:1876044545059072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135730.397759:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135730.397763:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135730.397765:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789135730.397768:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789135730.398095:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789135730.398172:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135730.398182:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135730.398193:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135730.398210:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135730.398212:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc057f3800 from 7 10000000:01000000:1.0:1789135730.398215:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135730.398237:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135730.398255:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135730.398264:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135730.398279:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135730.398313:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135730.398339:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc217ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135730.398949:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545059200 00000100:00100000:2.0:1789135730.398956:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545059200 00000100:00100000:2.0:1789135730.399001:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789135730.399015:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545059200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135730.399028:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135730.399040:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce404f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.399091:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.399102:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.399110:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2a00, rc 0) 00000100:00100000:2.0:1789135730.399152:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545059200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135730.399159:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789135730.399200:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135730.399213:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.399221:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135730.399302:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.399329:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.399353:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135730.399363:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545059328 00000100:00100000:2.0:1789135730.399367:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545059328 00000100:00100000:2.0:1789135730.399382:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789135730.399395:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545059328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.399601:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545059328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135730.400468:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789135730.400517:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.400555:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.400602:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.401399:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135730.404098:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545059456 00000100:00100000:1.0:1789135730.404113:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545059456 00000100:00100000:2.0:1789135730.406897:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789135730.406920:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545059456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.407255:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545059456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 337us (6651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135730.407262:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789135730.407379:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.411009:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11668:1876044545059584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135730.411121:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.411179:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135730.411218:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545059584 00000100:00100000:3.0:1789135730.411225:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545059584 00000100:00100000:3.0:1789135730.411284:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789135730.411294:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:11668:x1876044545059584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135730.411544:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11668:1876044545059584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135730.411575:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135730.411584:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135730.411587:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789135730.411593:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc057f3800 00000020:00000080:2.0:1789135730.411596:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135730.411641:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:11668:x1876044545059584:12345-0@lo:502:llog_process_th.0 Request processed in 205us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135730.411652:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789135730.412026:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11668:1876044545059712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135730.412088:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.412107:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135730.412258:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545059712 00000100:00100000:3.0:1789135730.412263:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545059712 00000100:00100000:3.0:1789135730.412284:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789135730.412291:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:11668:x1876044545059712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135730.412528:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:11668:x1876044545059712:12345-0@lo:502:llog_process_th.0 Request processed in 237us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135730.412535:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789135730.412618:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11668:1876044545059712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135730.412641:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135730.412647:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135730.412648:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789135730.412653:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789135730.413157:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789135730.413172:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135730.413179:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135730.413187:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135730.413273:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135730.413276:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc10b30000 from 7 10000000:01000000:3.0:1789135730.413279:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135730.413301:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135730.413307:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135730.413313:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135730.413324:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135730.413349:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135730.413377:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1569c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135730.413416:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545059840 00000100:00100000:2.0:1789135730.413420:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545059840 00000100:00100000:2.0:1789135730.413974:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789135730.413985:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545059840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135730.413997:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135730.414011:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce405d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.414032:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.414042:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135730.414050:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3200, rc 0) 00000100:00100000:2.0:1789135730.414211:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545059840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135730.414219:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789135730.414357:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135730.414372:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135730.414381:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135730.414565:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135730.414601:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135730.414809:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc217ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135730.415138:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545059968 00000100:00100000:2.0:1789135730.415144:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545059968 00000100:00100000:2.0:1789135730.415304:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789135730.415321:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545059968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.415596:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545059968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135730.415682:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789135730.416215:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545059968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135730.416283:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545060096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135730.416342:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135730.416392:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1569c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135730.416736:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545060096 00000100:00100000:2.0:1789135730.416742:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545060096 00000100:00100000:2.0:1789135730.416784:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789135730.416792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545060096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.416969:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545060096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135730.416976:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789135730.417174:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545060096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135730.417777:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11671:1876044545060224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135730.417821:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135730.417888:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135730.418179:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545060224 00000100:00100000:1.0:1789135730.418184:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545060224 00000100:00100000:1.0:1789135730.418227:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789135730.418234:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:11671:x1876044545060224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135730.418531:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:11671:x1876044545060224:12345-0@lo:502:llog_process_th.0 Request processed in 296us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135730.418538:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789135730.418638:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41909680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11671:1876044545060224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135730.418663:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135730.418672:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135730.418674:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789135730.418679:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc10b30000 00000020:00000080:3.0:1789135730.418682:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135730.418748:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11671:1876044545060352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135730.418788:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135730.418813:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545060352 00000100:00100000:3.0:1789135730.418817:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545060352 00000100:00100000:3.0:1789135730.418840:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789135730.418847:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:11671:x1876044545060352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135730.418976:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:11671:x1876044545060352:12345-0@lo:502:llog_process_th.0 Request processed in 129us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135730.418984:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789135730.419024:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07d6e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135730.419037:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:11671:1876044545060352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135730.419055:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135730.419077:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135730.419080:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789135730.419083:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789135730.419611:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789135730.419632:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135730.419642:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135730.419653:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135731.405315:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135732.428764:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135732.748575:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545060608:0@lo:400:kworker.0 00000100:00100000:1.0:1789135732.748646:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135732.748694:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545061120:0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.748912:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545060480:0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.748960:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135732.748986:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545060992:0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.749010:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135732.749016:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135732.749052:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135732.749052:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135732.749097:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545060864:0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.749122:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135732.749161:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545060736:0@lo:400:kworker.0 00000100:00100000:1.0:1789135732.749189:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135732.752027:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545060608 00000100:00100000:0.0:1789135732.752042:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545060608 00000100:00100000:3.0:1789135732.752375:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545060992 00000100:00100000:3.0:1789135732.752381:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545060992 00000100:00100000:3.0:1789135732.752423:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545060736 00000100:00100000:3.0:1789135732.752426:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545060736 00000100:00100000:3.0:1789135732.752447:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789135732.752467:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545060608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.752489:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789135732.752558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545060608:12345-0@lo:400:kworker.0 Request processed in 103us (3911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135732.752614:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545060992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.752656:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545060992:12345-0@lo:400:kworker.0 Request processed in 46us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135732.752692:0:7852:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00080000:1.0:1789135732.752705:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135732.752719:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545060480 00000100:00100000:1.0:1789135732.752723:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545060480 00000100:00100000:1.0:1789135732.752762:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789135732.752770:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545060480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135732.752822:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545060480:12345-0@lo:400:kworker.0 Request processed in 52us (3860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135732.752830:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789135732.752876:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789135732.752882:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789135732.752900:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545061120 00000100:00100000:1.0:1789135732.752904:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545061120 00000100:00100000:1.0:1789135732.752934:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545060864 00000100:00100000:1.0:1789135732.752938:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545060864 00000100:00100000:1.0:1789135732.752972:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135732.752979:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135732.753014:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545061120:12345-0@lo:400:kworker.0 Request processed in 35us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135732.753020:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135732.753038:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135732.753044:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545060864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135732.753100:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545060864:12345-0@lo:400:kworker.0 Request processed in 56us (3977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135732.753107:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789135732.754302:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135732.754308:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135732.759654:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545060608:0@lo:400:kworker.0 00010000:00080000:2.0:1789135732.759675:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc346e9e00 x1876044545061120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135732.759686:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545061120:0@lo:400:kworker.0 00000100:00100000:3.0:1789135732.760357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789135732.760395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789135732.760412:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545060736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135732.760576:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545060736:12345-0@lo:400:kworker.0 Request processed in 172us (11385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135732.760593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789135732.760628:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545060736:0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.760651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1789135732.760697:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc194543c0 x1876044545060864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135732.760710:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545060864:0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.760778:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545060480:0@lo:400:kworker.0 00000100:00100000:0.0:1789135732.760803:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545060992:0@lo:400:kworker.0 00000100:00100000:2.0:1789135733.263794:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135733.263817:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545061248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135733.263881:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135733.263961:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545061248 00000100:00100000:2.0:1789135733.263969:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545061248 00000100:00100000:2.0:1789135733.264016:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789135733.264040:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545061248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135733.264106:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135733.264150:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545061248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135733.264157:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789135733.264196:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bf92c0 x1876044545061248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135733.264214:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545061248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789135733.454023:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135733.700024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135733.700128:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135733.700157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135733.700417:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512512512 00000100:00100000:2.0:1789135733.700426:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512512512 00000100:00100000:2.0:1789135733.700492:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512512640 00000100:00100000:2.0:1789135733.700495:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512512640 00000100:00100000:2.0:1789135733.700514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:2.0:1789135733.700522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512512512:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135733.700599:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512512512:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 77us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135733.700606:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:2.0:1789135733.700621:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:2.0:1789135733.700626:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512512640:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135733.700647:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512512640:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 21us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135733.700653:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00080000:1.0:1789135733.701034:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135733.702790:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512512384 00000100:00100000:3.0:1789135733.702813:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512512384 00000100:00100000:3.0:1789135733.703342:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 281 00000100:00100000:3.0:1789135733.703351:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512512384:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135733.703430:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512512384:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 80us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135733.703438:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 281 00000100:00100000:0.0:1789135734.286103:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545061376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135734.286266:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135734.286399:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545061376 00000100:00100000:1.0:1789135734.286415:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545061376 00000100:00100000:1.0:1789135734.286482:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789135734.286493:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545061376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135734.286529:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135734.286578:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545061376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135734.286586:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789135734.286655:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135734.286690:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bff0c0 x1876044545061376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135734.286710:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545061376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135734.482080:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135734.569734:0:11809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:08:53 (1789135733) === 00010000:00010000:1.0:1789135735.502533:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135736.527438:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135736.859411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135736.859466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135736.859602:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512512896 00000100:00100000:0.0:1789135736.859611:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512512896 00000100:00100000:0.0:1789135736.859684:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:0.0:1789135736.859697:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:9947:x1876044512512896:12345-192.168.206.35@tcp:700:mkdir.0 00000100:00100000:0.0:1789135736.859785:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:9947:x1876044512512896:12345-192.168.206.35@tcp:700:mkdir.0 Request processed in 92us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135736.859793:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00080000:3.0:1789135736.860081:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135736.862145:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512512768 00000100:00100000:2.0:1789135736.862175:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512512768 00000100:00100000:2.0:1789135736.862248:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1789135736.862259:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512512768:12345-192.168.206.35@tcp:41:mkdir.0 00000004:00000024:2.0:1789135736.862297:0:11758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789135736.862469:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512512768:12345-192.168.206.35@tcp:41:mkdir.0 Request processed in 212us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135736.862476:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:1.0:1789135736.868149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135736.870546:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512513152 00000100:00100000:2.0:1789135736.870564:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512513152 00000100:00100000:2.0:1789135736.870639:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1789135736.870650:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:9947:x1876044512513152:12345-192.168.206.35@tcp:36:mkdir.0 00010000:00010000:2.0:1789135736.870707:0:7852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135736.870758:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc029e5400/0x5b09da6ee1ce3f0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d347e expref: 6 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.870783:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:2.0:1789135736.870797:0:7852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135736.871262:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.871276:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.871285:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.871296:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.871312:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.871318:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135736.872535:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789135736.872550:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.872559:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.872566:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.872573:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135736.872577:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.872602:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.872617:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171ae00) 00010000:00010000:2.0:1789135736.872621:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135736.872625:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.872631:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce406b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135736.872652:0:7852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000053bc974d reply state 000000003f724c6e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135736.872668:0:7852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135736.872758:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:9947:x1876044512513152:12345-192.168.206.35@tcp:36:mkdir.0 Request processed in 2107us (4615us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789135736.872767:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00010000:00010000:3.0:1789135736.879321:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.879335:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.879342:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.879348:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb3e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135736.879352:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.879359:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.879374:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adc1171aa00) 00010000:00010000:3.0:1789135736.879388:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135736.879393:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.879399:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce4072 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135736.882563:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135736.882813:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512513280 00000100:00100000:0.0:1789135736.882822:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512513280 00000100:00100000:0.0:1789135736.882880:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:0.0:1789135736.882890:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:9948:x1876044512513280:12345-192.168.206.35@tcp:101:chmod.0 00010000:00010000:0.0:1789135736.882910:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135736.882933:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3511 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.882993:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4080 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.883021:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.883033:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135736.883146:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789135736.883150:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135736.883194:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.883232:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3511 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.883250:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3511 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.883257:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc062d3400) 00010000:00010000:0.0:1789135736.883260:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135736.883264:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031800, rc 0) 00000100:00100000:0.0:1789135736.883318:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:9948:x1876044512513280:12345-192.168.206.35@tcp:101:chmod.0 Request processed in 431us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135736.883326:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:1.0:1789135736.886161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135736.886330:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512513536 00000100:00100000:0.0:1789135736.886340:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512513536 00000100:00100000:0.0:1789135736.886398:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:0.0:1789135736.886409:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:9948:x1876044512513536:12345-192.168.206.35@tcp:36:chmod.0 00010000:00010000:0.0:1789135736.886460:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135736.886499:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4080 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3511 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.886518:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc062d3400) 00010000:00010000:0.0:1789135736.886531:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135736.886557:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.886877:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.886889:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135736.888358:0:5837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002272d7ff reply state 0000000087d50c37 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135736.888374:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789135736.888397:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789135736.888489:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+8:9948:x1876044512513536:12345-192.168.206.35@tcp:36:chmod.0 Request processed in 2079us (2333us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789135736.888499:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00010000:00010000:3.0:1789135736.894525:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.894542:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.894549:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.894555:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42044000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135736.894559:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.894566:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.894583:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc062d3700) 00010000:00010000:3.0:1789135736.894586:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789135736.894590:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135736.894596:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4087 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135736.914307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135736.914403:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512513664 00000100:00100000:2.0:1789135736.914413:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512513664 00000100:00100000:2.0:1789135736.914463:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:2.0:1789135736.914481:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:9949:x1876044512513664:12345-192.168.206.35@tcp:101:chown.0 00010000:00010000:2.0:1789135736.914506:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135736.914526:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce408e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3518 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.914595:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce4095 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.914610:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce4095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.914622:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce4095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135736.914677:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789135736.914681:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135736.914738:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce4095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.914764:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce408e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3518 expref: 9 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.914815:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce4095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3518 expref: 8 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.914824:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171ae00) 00010000:00010000:2.0:1789135736.914827:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135736.914831:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3a00, rc 0) 00000100:00100000:2.0:1789135736.914892:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+8:9949:x1876044512513664:12345-192.168.206.35@tcp:101:chown.0 Request processed in 420us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135736.914899:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:1.0:1789135736.918325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135736.918420:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512513792 00000100:00100000:2.0:1789135736.918429:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512513792 00000100:00100000:2.0:1789135736.918578:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1789135736.918588:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+8:9949:x1876044512513792:12345-192.168.206.35@tcp:101:chown.0 00010000:00010000:2.0:1789135736.918606:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135736.918626:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce409c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d351f expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918711:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918737:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918749:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918764:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918778:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918795:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918887:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce40b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918895:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce40b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918902:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce40b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135736.918942:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789135736.918946:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135736.918967:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce40b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918979:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.918985:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.919003:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.919010:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135736.919013:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.919027:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.919039:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171ae00) 00010000:00010000:2.0:1789135736.919042:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135736.919047:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.919052:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922331:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922346:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922355:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922361:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135736.922365:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922373:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922389:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adc1171a200) 00010000:00010000:2.0:1789135736.922392:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135736.922396:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922424:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922580:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3e00/0x5b09da6ee1ce409c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d351f expref: 10 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922597:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce40b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d351f expref: 9 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135736.922606:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135736.922608:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135736.922611:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2400, rc 0) 00000100:00100000:2.0:1789135736.922727:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+9:9949:x1876044512513792:12345-192.168.206.35@tcp:101:chown.0 Request processed in 4139us (4410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135736.922736:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:1.0:1789135736.932718:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135736.932951:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512514048 00000100:00100000:0.0:1789135736.932960:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512514048 00000100:00100000:0.0:1789135736.933169:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:0.0:1789135736.933180:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+9:9949:x1876044512514048:12345-192.168.206.35@tcp:36:chown.0 00010000:00010000:0.0:1789135736.933245:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135736.933270:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce40b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d351f expref: 9 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.933306:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135736.933320:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135736.933344:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.933355:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.933365:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135736.993943:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789135736.995944:0:5837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000894aef75 reply state 000000003622725c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135736.995965:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789135736.996318:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1789135736.996453:0:5837:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789135736.996490:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:9949:x1876044512514048:12345-192.168.206.35@tcp:36:chown.0 Request processed in 63309us (63778us total) trans 4294967299 rc 0/0 00010000:00010000:0.0:1789135736.996652:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.996662:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.996669:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.996674:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135736.996678:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.996685:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.996700:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3400) 00010000:00010000:0.0:1789135736.996702:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135736.996707:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135736.996720:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135736.997912:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:1.0:1789135737.017938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135737.018051:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512514176 00000100:00100000:0.0:1789135737.018086:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512514176 00000100:00100000:0.0:1789135737.018150:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:0.0:1789135737.018160:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:9950:x1876044512514176:12345-192.168.206.35@tcp:101:touch.500 00010000:00010000:0.0:1789135737.018272:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135737.018295:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3526 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135737.024371:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6025us 00010000:00010000:0.0:1789135737.034325:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.034346:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.034356:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.034369:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.034375:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.034380:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.034792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce40d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.034802:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce40d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.034810:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce40d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135737.034881:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789135737.034885:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135737.036625:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce40d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036646:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036653:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036660:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036679:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135737.036683:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036691:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036710:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171ae00) 00010000:00010000:1.0:1789135737.036714:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135737.036719:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036725:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce40c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036739:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036745:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036751:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036757:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135737.036760:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036766:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036784:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adc062d3400) 00010000:00010000:1.0:1789135737.036786:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135737.036789:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036794:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce40cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036834:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce40bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3526 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036849:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce40d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3526 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.036856:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3e00) 00010000:00010000:1.0:1789135737.036858:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789135737.036860:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045000, rc 0) 00000100:00100000:1.0:1789135737.036932:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:9950:x1876044512514176:12345-192.168.206.35@tcp:101:touch.500 Request processed in 18773us (19003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135737.036941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:1.0:1789135737.047439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135737.047553:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512514432 00000100:00100000:2.0:1789135737.047562:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512514432 00000100:00100000:2.0:1789135737.047673:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:2.0:1789135737.047683:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+7:9950:x1876044512514432:12345-192.168.206.35@tcp:101:touch.500 00010000:00010000:2.0:1789135737.047702:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135737.047719:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d352d expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.048287:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.048303:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.048314:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.048377:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.048384:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.048391:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135737.049143:0:11758:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789135737.049891:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce40f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.049907:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce40f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.049918:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce40f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.049951:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.050021:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.050028:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.050034:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135737.050039:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.050134:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.050150:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3e00) 00010000:00010000:2.0:1789135737.050152:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135737.050157:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.050330:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce40e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135737.050349:0:11758:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006d38cca9 reply state 00000000949ffb64 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135737.050358:0:11758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789135737.050395:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce40db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d352d expref: 10 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.050541:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce40f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d352d expref: 9 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.050563:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:2.0:1789135737.050565:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135737.050568:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2600, rc 0) 00000100:00100000:2.0:1789135737.050656:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+10:9950:x1876044512514432:12345-192.168.206.35@tcp:101:touch.500 Request processed in 2974us (3226us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789135737.050664:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:3.0:1789135737.057018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:0.0:1789135737.057648:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.057662:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.057669:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.057676:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135737.057680:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.057688:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135737.057698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512514688 00010000:00010000:0.0:1789135737.057703:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x88a17eea (ffff8adc1171a200) 00000100:00100000:1.0:1789135737.057706:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512514688 00010000:00010000:0.0:1789135737.057706:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135737.057710:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.057749:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce40e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135737.057769:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:1.0:1789135737.057779:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+9:9950:x1876044512514688:12345-192.168.206.35@tcp:36:touch.500 00010000:00010000:1.0:1789135737.057831:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135737.057849:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce40f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d352d expref: 9 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.057867:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:1.0:1789135737.057874:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135737.057911:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.057922:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.057930:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135737.058094:0:5837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fb09f12f reply state 00000000fad28593 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135737.058103:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135737.058191:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+10:9950:x1876044512514688:12345-192.168.206.35@tcp:36:touch.500 Request processed in 413us (1183us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789135737.058198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00010000:00010000:3.0:1789135737.060451:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.060469:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.060476:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.060482:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135737.060487:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.060495:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.060511:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8adc1953c400) 00010000:00010000:3.0:1789135737.060514:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135737.060519:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.060537:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce40fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135737.061697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135737.061790:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512514816 00000100:00100000:1.0:1789135737.061800:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512514816 00000100:00100000:1.0:1789135737.061875:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1789135737.061886:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:9950:x1876044512514816:12345-192.168.206.35@tcp:101:touch.500 00010000:00010000:1.0:1789135737.061911:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135737.061935:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab000/0x5b09da6ee1ce4105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3534 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.061991:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab000/0x5b09da6ee1ce4105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3534 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.062024:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab000/0x5b09da6ee1ce4105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3534 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.062045:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135737.062048:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135737.062051:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab000, rc 0) 00000100:00100000:1.0:1789135737.062149:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+10:9950:x1876044512514816:12345-192.168.206.35@tcp:101:touch.500 Request processed in 264us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135737.062156:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1789135737.067370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135737.067692:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512514944 00000100:00100000:2.0:1789135737.067702:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512514944 00000100:00100000:2.0:1789135737.067759:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:2.0:1789135737.067767:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2374:x1876044512514944:12345-192.168.206.35@tcp:8:touch.500 00010000:00080000:2.0:1789135737.067796:0:6765:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:2.0:1789135737.067826:0:6765:0:(genops.c:1385:class_connect()) connect: client 5f7ef768-1508-4eda-9824-c10078b0a61e, cookie 0x5b09da6ee1ce410c 00002000:00100000:2.0:1789135737.067838:0:6765:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f7ef768-1508-4eda-9824-c10078b0a61e/ffff8adc057f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789135737.067870:0:6765:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789135737.068139:0:6765:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789135737.068170:0:6765:0:(import.c:65:import_set_state_nolock()) ffff8adc41913000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135737.069196:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2374:x1876044512514944:12345-192.168.206.35@tcp:8:touch.500 Request processed in 1423us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.069221:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:3.0:1789135737.075524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135737.075638:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512515072 00000100:00100000:1.0:1789135737.075648:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512515072 00000100:00100000:1.0:1789135737.075725:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:1.0:1789135737.075735:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:0:x1876044512515072:12345-192.168.206.35@tcp:2:touch.500 00000100:00080000:3.0:1789135737.078861:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135737.125684:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:0:x1876044512515072:12345-192.168.206.35@tcp:2:touch.500 Request processed in 49940us (50160us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789135737.125699:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00000001:00080000:3.0:1789135737.125796:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1789135737.125829:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000100:00100000:3.0:1789135737.129053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135737.129261:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512515328 00000100:00100000:2.0:1789135737.129270:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512515328 00000100:00100000:2.0:1789135737.129322:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1789135737.129333:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+10:9950:x1876044512515328:12345-192.168.206.35@tcp:35:touch.500 00000100:00100000:2.0:1789135737.129674:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+11:9950:x1876044512515328:12345-192.168.206.35@tcp:35:touch.500 Request processed in 341us (627us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789135737.129696:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1789135737.151587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135737.151693:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512515456 00000100:00100000:0.0:1789135737.151702:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512515456 00000100:00100000:0.0:1789135737.151789:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:0.0:1789135737.151800:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+11:9951:x1876044512515456:12345-192.168.206.35@tcp:101:rm.0 00010000:00010000:0.0:1789135737.151822:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135737.151843:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d353b expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.151904:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce411a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.151919:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.151930:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135737.151981:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789135737.151985:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135737.152022:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.152097:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d353b expref: 13 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.152117:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce411a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d353b expref: 12 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.152138:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3e00) 00010000:00010000:0.0:1789135737.152141:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135737.152145:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045a00, rc 0) 00000100:00100000:0.0:1789135737.152216:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+12:9951:x1876044512515456:12345-192.168.206.35@tcp:101:rm.0 Request processed in 407us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.152224:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:0.0:1789135737.157257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135737.159017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512515712 00000100:00100000:1.0:1789135737.159034:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512515712 00000100:00100000:1.0:1789135737.159144:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:1.0:1789135737.159154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+12:9951:x1876044512515712:12345-192.168.206.35@tcp:101:rm.0 00010000:00010000:1.0:1789135737.159174:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135737.159194:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3542 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135737.159333:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789135737.160474:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4121 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3542 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.160491:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171ae00) 00010000:00010000:1.0:1789135737.160495:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135737.160499:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3542 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.160514:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34baaa00, rc 0) 00000100:00100000:1.0:1789135737.160575:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:9951:x1876044512515712:12345-192.168.206.35@tcp:101:rm.0 Request processed in 1423us (3327us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789135737.160583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:3.0:1789135737.166341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135737.166621:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512515840 00000100:00100000:2.0:1789135737.166629:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512515840 00000100:00100000:2.0:1789135737.166679:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:2.0:1789135737.166686:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:9951:x1876044512515840:12345-192.168.206.35@tcp:37:rm.0 00000100:00100000:0.0:1789135737.173932:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:9951:x1876044512515840:12345-192.168.206.35@tcp:37:rm.0 Request processed in 7234us (7589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.173949:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:0.0:1789135737.185478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135737.185553:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512516096 00000100:00100000:3.0:1789135737.185562:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512516096 00000100:00100000:3.0:1789135737.185616:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:3.0:1789135737.185625:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+13:9951:x1876044512516096:12345-192.168.206.35@tcp:35:rm.0 00000100:00100000:3.0:1789135737.186009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+14:9951:x1876044512516096:12345-192.168.206.35@tcp:35:rm.0 Request processed in 384us (539us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789135737.186015:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:1.0:1789135737.188858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135737.189967:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512516352 00000100:00100000:2.0:1789135737.189978:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512516352 00000100:00100000:2.0:1789135737.190043:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:2.0:1789135737.190053:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+14:9951:x1876044512516352:12345-192.168.206.35@tcp:101:rm.0 00010000:00010000:2.0:1789135737.190116:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135737.190136:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce412f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3549 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.190264:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4136 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.190278:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.190289:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4136 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135737.190299:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1789135737.190475:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce412f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3549 expref: 17 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.190493:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4136 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3549 expref: 16 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.190507:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3e00) 00010000:00010000:2.0:1789135737.190509:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135737.190513:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3a00, rc 0) 00000100:00100000:2.0:1789135737.190563:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+16:9951:x1876044512516352:12345-192.168.206.35@tcp:101:rm.0 Request processed in 512us (1714us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789135737.190570:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:2.0:1789135737.195793:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135737.195877:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512516480 00000100:00100000:1.0:1789135737.195887:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512516480 00000100:00100000:1.0:1789135737.195942:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:1.0:1789135737.195952:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+16:9951:x1876044512516480:12345-192.168.206.35@tcp:41:rm.0 00000004:00000024:1.0:1789135737.196007:0:11758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789135737.196108:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+16:9951:x1876044512516480:12345-192.168.206.35@tcp:41:rm.0 Request processed in 157us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135737.196116:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:0.0:1789135737.198841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135737.199102:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512516608 00000100:00100000:1.0:1789135737.199111:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512516608 00000100:00100000:1.0:1789135737.199162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:1.0:1789135737.199171:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+16:9951:x1876044512516608:12345-192.168.206.35@tcp:101:rm.0 00010000:00010000:1.0:1789135737.199198:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135737.199230:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3550 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199288:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199303:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199315:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199329:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199335:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199341:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199528:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce4159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199538:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce4159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199546:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce4159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135737.199573:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789135737.199583:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135737.199603:0:5837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce4159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199615:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce4159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199624:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199630:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199637:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199643:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baac00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135737.199647:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199654:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199665:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3e00) 00010000:00010000:1.0:1789135737.199668:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135737.199672:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199679:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce414b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199691:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199706:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199711:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199717:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135737.199720:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199727:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199735:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x88a17eea (ffff8adc1953c200) 00010000:00010000:1.0:1789135737.199738:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135737.199740:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199746:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199774:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3550 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199799:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce4159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3550 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.199807:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135737.199810:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135737.199818:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab200, rc 0) 00000100:00100000:1.0:1789135737.200001:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+17:9951:x1876044512516608:12345-192.168.206.35@tcp:101:rm.0 Request processed in 830us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135737.200009:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:2.0:1789135737.203749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135737.203941:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512516864 00000100:00100000:1.0:1789135737.203951:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512516864 00000100:00100000:1.0:1789135737.204019:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:1.0:1789135737.204029:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+17:9951:x1876044512516864:12345-192.168.206.35@tcp:36:rm.0 00010000:00010000:1.0:1789135737.204128:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789135737.204154:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce4159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3550 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204173:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab000/0x5b09da6ee1ce4105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3534 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204183:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135737.204499:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce411a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d353b expref: 15 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204511:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3e00) 00010000:00010000:1.0:1789135737.204515:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135737.204534:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204547:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204556:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204587:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204595:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204602:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204736:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204745:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.204752:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135737.205997:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789135737.206008:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360777945186ns, next at 361777943103ns, rc = 0 00010000:00010000:1.0:1789135737.206261:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206274:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206284:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206292:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206311:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206317:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206408:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135737.206430:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206437:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206442:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206448:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baac00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135737.206452:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206459:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206480:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:1.0:1789135737.206483:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789135737.206488:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206494:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce416e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206511:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206522:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206528:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206533:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baaa00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135737.206536:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206542:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206551:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3e00) 00010000:00010000:1.0:1789135737.206553:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135737.206556:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.206561:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce4160 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135737.206570:0:5836:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008b1477f4 reply state 000000008268cd15 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135737.206577:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135737.206666:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+16:9951:x1876044512516864:12345-192.168.206.35@tcp:36:rm.0 Request processed in 2628us (2916us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789135737.206675:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00010000:00010000:2.0:1789135737.206897:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135737.206903:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.206909:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baba00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135737.206912:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.206918:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.206927:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:2.0:1789135737.206930:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789135737.206933:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.206939:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baba00/0x5b09da6ee1ce4175 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.206955:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135737.206965:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135737.206966:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135737.208777:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.208850:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.208858:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.208876:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135737.208881:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.208888:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.208919:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x88a17eea (ffff8adc1953c200) 00010000:00010000:0.0:1789135737.208922:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135737.208927:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.208934:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab600/0x5b09da6ee1ce4167 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x88a17eea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135737.210592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135737.211685:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512517120 00000100:00100000:0.0:1789135737.211696:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512517120 00000100:00100000:0.0:1789135737.211792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1789135737.211802:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+15:9951:x1876044512517120:12345-192.168.206.35@tcp:35:rm.0 00000100:00100000:0.0:1789135737.212059:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+16:9951:x1876044512517120:12345-192.168.206.35@tcp:35:rm.0 Request processed in 257us (1487us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789135737.212091:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:3.0:1789135737.214924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135737.214981:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512517376 00000100:00100000:1.0:1789135737.214989:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512517376 00000100:00100000:1.0:1789135737.215058:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:1.0:1789135737.215192:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+16:9951:x1876044512517376:12345-192.168.206.35@tcp:36:rm.0 00010000:00010000:1.0:1789135737.215257:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789135737.215281:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4136 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3549 expref: 16 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215302:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce40d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3526 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215313:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc062d3e00) 00010000:00010000:1.0:1789135737.215327:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce4095 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3518 expref: 14 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215335:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171ae00) 00010000:00010000:1.0:1789135737.215342:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135737.215364:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215376:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215385:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215397:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215404:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215421:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215716:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215740:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.215748:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135737.219034:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789135737.219058:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.219093:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.219102:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.219108:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135737.219112:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.219119:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.219134:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:1.0:1789135737.219137:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789135737.220984:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.221001:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce418a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.221041:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.221048:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.221054:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.221060:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baaa00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135737.221078:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.221086:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.221100:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135737.221102:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135737.221106:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.221112:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce417c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135737.221124:0:5838:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004c30eaff reply state 00000000cd84b7d9 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135737.221151:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135737.221258:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+15:9951:x1876044512517376:12345-192.168.206.35@tcp:36:rm.0 Request processed in 6067us (6336us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789135737.221266:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 31 00010000:00010000:3.0:1789135737.226147:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.226166:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.226174:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.226180:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baac00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135737.226184:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.226191:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.226223:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8adc1953cc00) 00010000:00010000:3.0:1789135737.226226:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135737.226246:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.226252:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baac00/0x5b09da6ee1ce4183 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.548293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135737.868835:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545061760:0@lo:400:kworker.0 00000100:00100000:3.0:1789135737.868910:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.869031:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545061632:0@lo:400:kworker.0 00000100:00100000:2.0:1789135737.869083:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.869125:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545062144:0@lo:400:kworker.0 00000100:00100000:2.0:1789135737.869151:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.869197:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545062144 00000100:00100000:2.0:1789135737.869216:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545062144 00000100:00100000:2.0:1789135737.869277:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789135737.869286:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545062144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135737.869336:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545062144:12345-0@lo:400:kworker.0 Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.869344:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789135737.869377:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789135737.869407:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bf83c0 x1876044545062144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135737.869420:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545062144:0@lo:400:kworker.0 00000100:00100000:2.0:1789135737.869446:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545061760 00000100:00100000:2.0:1789135737.869450:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545061760 00000100:00100000:2.0:1789135737.869478:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545061632 00000100:00100000:2.0:1789135737.869481:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545061632 00000100:00100000:2.0:1789135737.869500:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789135737.869507:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545061760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135737.869552:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545061760:12345-0@lo:400:kworker.0 Request processed in 45us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.869559:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789135737.869585:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789135737.869591:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41909680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545061632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135737.869753:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41909680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545061632:12345-0@lo:400:kworker.0 Request processed in 161us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.869761:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1789135737.869777:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135737.869795:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545061632:0@lo:400:kworker.0 00000100:00100000:3.0:1789135737.870180:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545061760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135737.870407:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545061504:0@lo:400:kworker.0 00000100:00100000:0.0:1789135737.870450:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135737.870486:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545062016:0@lo:400:kworker.0 00000100:00100000:0.0:1789135737.870510:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135737.870708:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545061888:0@lo:400:kworker.0 00000100:00100000:1.0:1789135737.870741:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135737.871059:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545061888 00000100:00100000:1.0:1789135737.871083:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545061888 00000100:00100000:1.0:1789135737.871129:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789135737.871137:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545061888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135737.871181:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545061888:12345-0@lo:400:kworker.0 Request processed in 45us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135737.871189:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789135737.871344:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135737.871866:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545061504 00000100:00100000:3.0:1789135737.871872:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545061504 00000100:00100000:3.0:1789135737.871907:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789135737.871914:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545061504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135737.872054:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545061504:12345-0@lo:400:kworker.0 Request processed in 140us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135737.872083:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789135737.872126:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545061504:0@lo:400:kworker.0 00010000:00080000:3.0:1789135737.872174:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bfa940 x1876044545061888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135737.872185:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545061888:0@lo:400:kworker.0 00000100:00100000:2.0:1789135737.872550:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545062016 00000100:00100000:2.0:1789135737.872555:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545062016 00000100:00100000:2.0:1789135737.872597:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1789135737.872752:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135737.872833:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545062016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135737.872889:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545062016:12345-0@lo:400:kworker.0 Request processed in 285us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.872896:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789135737.876266:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545062016:0@lo:400:kworker.0 00000100:00100000:1.0:1789135738.380539:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545062272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135738.380610:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135738.380701:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545062272 00000100:00100000:0.0:1789135738.380708:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545062272 00000100:00100000:0.0:1789135738.380780:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789135738.380792:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545062272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135738.380827:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135738.380882:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545062272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135738.380902:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789135738.383330:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bfa940 x1876044545062272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135738.383356:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545062272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789135738.572299:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135738.807573:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135738.807629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135738.807660:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512517504 00000100:00100000:3.0:1789135738.807665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135738.807671:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512517504 00000100:00100000:3.0:1789135738.807699:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135738.807729:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512517632 00000100:00100000:1.0:1789135738.807730:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 283 00000100:00100000:1.0:1789135738.807741:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512517504:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135738.807746:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512517632 00000100:00100000:3.0:1789135738.807793:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512517888 00000100:00100000:3.0:1789135738.807796:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512517888 00000100:00100000:3.0:1789135738.807820:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:3.0:1789135738.807828:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+14:2377:x1876044512517632:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135738.807840:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512517760 00000100:00100000:2.0:1789135738.807846:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512517760 00000100:00100000:2.0:1789135738.807879:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:2.0:1789135738.807887:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512517760:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135738.807906:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+14:2377:x1876044512517632:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.807914:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:2.0:1789135738.807926:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512517760:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135738.807934:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:3.0:1789135738.807951:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00100000:3.0:1789135738.807960:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512517888:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135738.807995:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512517888:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 35us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.808001:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00080000:3.0:1789135738.808218:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135738.808266:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512517504:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 527us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135738.808275:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 283 00000004:00080000:1.0:1789135739.428999:0:6763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363000675232ns, next at 364000672667ns, rc = 0 00000100:00100000:1.0:1789135739.429025:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135739.429102:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545062400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135739.429177:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135739.429254:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545062400 00000100:00100000:1.0:1789135739.429261:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545062400 00000100:00100000:1.0:1789135739.429368:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789135739.429378:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545062400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135739.429411:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135739.429475:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545062400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135739.429482:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1789135739.430952:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bfde00 x1876044545062400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135739.430977:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545062400:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789135739.432604:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789135739.596762:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135740.620272:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789135741.263037:0:12008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1789135741.645170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789135742.066665:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1789135742.066846:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789135742.066868:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1789135742.066875:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789135742.067103:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545062528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789135742.067197:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135742.067312:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545062528 00000100:00100000:1.0:1789135742.067320:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545062528 00000100:00100000:1.0:1789135742.067390:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135742.067401:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545062528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789135742.067430:0:6682:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789135742.067482:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa40b79, atime: 0x6aa40b79, ctime: 0x6aa40b79, blocks: 0x1 00010000:00010000:1.0:1789135742.067490:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.067524:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789135742.067529:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135742.067536:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.067553:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.067563:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.067571:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.067589:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789135742.068161:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876044545062528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 761us (963us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789135742.068170:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1789135742.068242:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc41bfde00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789135742.068248:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545062528:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1789135742.068311:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789135742.069359:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135742.069369:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.069380:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baaa00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135742.069385:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.069395:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.069416:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.069424:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9066150/0x5b09da6ee1ce4191 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.069457:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135742.069459:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135742.069460:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789135742.587259:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1789135742.673669:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789135742.725297:0:12057:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8f893d40 20000000:00000080:1.0:1789135742.725313:0:12057:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc03f8d000 uarg=0000000000000000 20000000:01000000:1.0:1789135742.725350:0:12057:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789135742.725356:0:12057:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789135742.725361:0:12057:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789135742.726215:0:12058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789135742.726372:0:12057:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789135742.733812:0:12057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:1.0:1789135742.733894:0:12057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:1.0:1789135742.733931:0:12057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:1.0:1789135742.733947:0:12057:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789135742.733966:0:12057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.733982:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.733990:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.733997:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734003:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734009:0:12057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734015:0:12057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734091:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734107:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 18 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.734132:0:12057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545062656:0@lo:104: 00000100:00100000:1.0:1789135742.734203:0:12057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135742.734254:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734262:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 18 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.734270:0:12057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545062784:0@lo:104: 00000100:00100000:1.0:1789135742.734291:0:12057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135742.734321:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734328:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 18 pid: 5831 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.734336:0:12057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545062912:0@lo:104: 00000100:00100000:1.0:1789135742.734355:0:12057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135742.734372:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734382:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 12 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.734392:0:12057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545063040:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135742.734441:0:12057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135742.734460:0:12057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.734469:0:12057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545063168:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135742.734493:0:12057:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05c21e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135742.735469:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545062656 00000100:00100000:3.0:1789135742.735480:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545062656 00000100:00100000:3.0:1789135742.735520:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545062784 00000100:00100000:3.0:1789135742.735524:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545062784 00000100:00100000:3.0:1789135742.735534:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545062912 00000100:00100000:3.0:1789135742.735536:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545062912 00000100:00100000:3.0:1789135742.735549:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789135742.735557:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+5:12057:x1876044545062656:12345-0@lo:104: 00010000:00010000:3.0:1789135742.735571:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.735656:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135742.735663:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+5:12057:x1876044545062656:12345-0@lo:104: Request processed in 106us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.735670:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789135742.735687:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789135742.735692:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:12057:x1876044545062784:12345-0@lo:104: 00010000:00010000:3.0:1789135742.735700:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.735731:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789135742.735735:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+4:12057:x1876044545062784:12345-0@lo:104: Request processed in 44us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.735741:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789135742.735763:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135742.735770:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:12057:x1876044545062912:12345-0@lo:104: 00010000:00010000:3.0:1789135742.735777:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.735806:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789135742.735811:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:45dd8677-45c4-4169-a65f-287162436408+3:12057:x1876044545062912:12345-0@lo:104: Request processed in 42us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.735817:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789135742.735923:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789135742.735930:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.735946:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fe00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135742.735950:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.735957:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135742.735963:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135742.735968:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135742.735999:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736005:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135742.736024:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736031:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce405d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4064 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736041:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135742.736044:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736049:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34babc00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135742.736052:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736094:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135742.736100:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135742.736105:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135742.736118:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736124:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135742.736130:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736136:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc34babc00/0x5b09da6ee1ce404f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4056 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736156:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135742.736159:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736165:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2200 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135742.736167:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736183:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135742.736189:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135742.736200:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135742.736215:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736220:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135742.736235:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736243:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2200/0x5b09da6ee1ce4041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce4048 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736256:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135742.736258:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135742.736259:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135742.736266:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135742.736284:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545063296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135742.736320:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135742.736354:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135742.736359:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545063424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135742.736379:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135742.736403:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135742.736410:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545063552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135742.736432:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135742.736457:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545063296 00000100:00100000:3.0:1789135742.736461:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545063296 00010000:00010000:3.0:1789135742.736479:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 19 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135742.736511:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545063424 00000100:00100000:3.0:1789135742.736515:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545063424 00010000:00010000:3.0:1789135742.736527:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 20 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135742.736541:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545063552 00000100:00100000:3.0:1789135742.736543:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545063552 00010000:00010000:3.0:1789135742.736552:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 21 pid: 5831 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135742.736562:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789135742.736567:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+21:3315:x1876044545063296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135742.736576:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135742.736580:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 21 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736589:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 21 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736604:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135742.736630:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+21:3315:x1876044545063296:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.736636:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789135742.736648:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789135742.736653:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+20:3315:x1876044545063424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135742.736661:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135742.736665:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 20 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736683:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 20 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736692:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135742.736714:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+20:3315:x1876044545063424:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.736720:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789135742.736732:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135742.736738:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545063552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135742.736745:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135742.736749:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 19 pid: 5831 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736758:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 19 pid: 5831 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.736767:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135742.736792:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545063552:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.736797:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135742.736837:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545063552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135742.736862:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545063424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135742.736870:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545063296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135742.737332:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135742.739989:0:12057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb3200/0x5b09da6ee1ce4064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce405d expref: 18 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.740010:0:12057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545062656:0@lo:104: 00010000:00010000:1.0:1789135742.740022:0:12057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2a00/0x5b09da6ee1ce4056 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce404f expref: 17 pid: 5830 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.740031:0:12057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545062784:0@lo:104: 00010000:00010000:1.0:1789135742.740040:0:12057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030800/0x5b09da6ee1ce4048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce4041 expref: 16 pid: 5831 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.740048:0:12057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545062912:0@lo:104: 00000100:00100000:2.0:1789135742.745909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135742.746006:0:12057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545063040:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135742.746016:0:12057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12057:1876044545063168:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135742.746046:0:12057:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135742.746184:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512518016 00000100:00100000:3.0:1789135742.746191:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512518016 00010000:00010000:3.0:1789135742.746225:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 13 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135742.746294:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:2.0:1789135742.746305:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512518016:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135742.746319:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135742.746326:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 13 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.746348:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 13 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.746365:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031400/0x5b09da6ee1ce403a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d350a expref: 13 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.746379:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135742.746432:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c10fadf3-edc6-4c88-b194-561a01ca971d+12:2376:x1876044512518016:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 128us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135742.746440:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1789135742.748275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135742.748551:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512518144 00000100:00100000:3.0:1789135742.748559:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512518144 00010000:00010000:3.0:1789135742.748589:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135742.748629:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:3.0:1789135742.748637:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05776050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c10fadf3-edc6-4c88-b194-561a01ca971d+12:2375:x1876044512518144:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135742.748650:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135742.748655:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748666:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748682:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce4033 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3503 expref: 12 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748696:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748704:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748719:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748726:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748745:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748751:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748757:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baac00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135742.748761:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748901:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748926:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135742.748936:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135742.748991:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05776050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c10fadf3-edc6-4c88-b194-561a01ca971d+11:2375:x1876044512518144:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 354us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.748999:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00010000:00010000:2.0:1789135742.750096:0:12057:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.750108:0:12057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135742.750115:0:12057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce4198 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135742.988870:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545063808:0@lo:400:kworker.0 00000100:00100000:1.0:1789135742.988940:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135742.988951:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545064064:0@lo:400:kworker.0 00000100:00100000:1.0:1789135742.989003:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135742.989008:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135742.989013:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545063936:0@lo:400:kworker.0 00000100:00100000:1.0:1789135742.989057:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135742.989057:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135742.989092:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545063680:0@lo:400:kworker.0 00000100:00100000:0.0:1789135742.989123:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135742.989150:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545064192:0@lo:400:kworker.0 00000100:00100000:0.0:1789135742.989180:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135742.989257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545063808 00000100:00100000:1.0:1789135742.989263:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545063808 00000100:00100000:1.0:1789135742.989317:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545064064 00000100:00100000:1.0:1789135742.989322:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545064064 00000100:00100000:3.0:1789135742.989338:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545063680 00000100:00100000:3.0:1789135742.989345:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545063680 00000100:00100000:1.0:1789135742.989354:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789135742.989375:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789135742.989381:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545063808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135742.989389:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545064064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135742.989460:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545064064:12345-0@lo:400:kworker.0 Request processed in 76us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.989467:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789135742.989494:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789135742.989508:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545063680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135742.989551:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545063808:12345-0@lo:400:kworker.0 Request processed in 174us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135742.989558:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789135742.989599:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545063808:0@lo:400:kworker.0 00000100:00100000:3.0:1789135742.989663:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545063680:12345-0@lo:400:kworker.0 Request processed in 156us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135742.989671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789135742.989692:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135742.989720:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a301e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545063680:0@lo:400:kworker.0 00000100:00100000:3.0:1789135742.989731:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545064064:0@lo:400:kworker.0 00000100:00100000:2.0:1789135742.995647:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545063936 00000100:00100000:2.0:1789135742.995661:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545063936 00000100:00100000:2.0:1789135742.995725:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545064192 00000100:00100000:2.0:1789135742.995729:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545064192 00000100:00080000:3.0:1789135742.996141:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135742.996615:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135742.996630:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789135742.996631:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545063936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135742.996729:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545063936:12345-0@lo:400:kworker.0 Request processed in 105us (7672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135742.996737:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135742.996778:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789135742.996784:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc41bfde00, transno 4294967300 00000100:00100000:0.0:1789135742.996807:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545063936:0@lo:400:kworker.0 00000100:00100000:2.0:1789135743.000134:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545064192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135743.000431:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545064192:12345-0@lo:400:kworker.0 Request processed in 3790us (11257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135743.000443:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1789135743.000532:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bfcb40 x1876044545064192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135743.000549:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545064192:0@lo:400:kworker.0 00000100:00100000:1.0:1789135743.500356:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545064320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135743.500431:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135743.500474:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545064320 00000100:00100000:0.0:1789135743.500482:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545064320 00000100:00100000:0.0:1789135743.500565:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789135743.500575:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545064320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135743.500708:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135743.500927:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545064320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 353us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135743.500934:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789135743.501099:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc194543c0 x1876044545064320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135743.501119:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545064320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789135743.694755:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135743.926460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135743.926504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135743.926540:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135743.926575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135743.926599:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512518272 00000100:00100000:1.0:1789135743.926607:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512518272 00000100:00100000:2.0:1789135743.926620:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512518528 00000100:00100000:2.0:1789135743.926624:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512518528 00000100:00100000:1.0:1789135743.926647:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 284 00000100:00100000:1.0:1789135743.926656:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+11:2378:x1876044512518272:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135743.926657:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:2.0:1789135743.926663:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512518528:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135743.926712:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512518528:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 49us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135743.926719:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:0.0:1789135743.926747:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512518400 00000100:00100000:0.0:1789135743.926751:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512518400 00000100:00100000:0.0:1789135743.926776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512518656 00000100:00100000:0.0:1789135743.926778:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512518656 00000100:00100000:0.0:1789135743.926794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00100000:0.0:1789135743.926799:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512518400:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135743.926858:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 129 00000100:00100000:3.0:1789135743.926867:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512518656:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135743.926957:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+11:2378:x1876044512518272:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 302us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135743.926977:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 284 00000100:00100000:0.0:1789135743.928718:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512518400:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 1911us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135743.928728:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00080000:0.0:1789135743.928766:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135743.928772:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135743.933682:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512518656:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 6797us (7158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135743.933703:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 129 00000100:00100000:0.0:1789135744.179506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.179582:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512518784 00000100:00100000:1.0:1789135744.179591:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512518784 00000100:00100000:1.0:1789135744.179650:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 285 00000100:00100000:1.0:1789135744.179660:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+11:5620:x1876044512518784:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135744.179676:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135744.179693:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce419f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3557 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.179717:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce419f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3557 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.179728:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce419f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3557 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.179738:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34baba00, rc 0) 00000100:00100000:1.0:1789135744.179795:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512518784:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 136us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.179802:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 285 00000100:00100000:2.0:1789135744.187936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.188033:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512518912 00000100:00100000:1.0:1789135744.188043:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512518912 00000100:00100000:1.0:1789135744.188157:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 286 00000100:00100000:1.0:1789135744.188181:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512518912:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.188493:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512518912:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 325us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.188502:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 286 00000100:00100000:2.0:1789135744.195562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135744.196527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512519040 00000100:00100000:3.0:1789135744.196538:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512519040 00000100:00100000:3.0:1789135744.199057:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 287 00000100:00100000:3.0:1789135744.199110:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512519040:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135744.199362:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512519040:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 275us (3806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.199370:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 287 00000100:00100000:0.0:1789135744.211464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.211696:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512519168 00000100:00100000:1.0:1789135744.211706:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512519168 00000100:00100000:1.0:1789135744.211768:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 288 00000100:00100000:1.0:1789135744.211778:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:10221:x1876044512519168:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135744.212028:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:10221:x1876044512519168:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 250us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.212131:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 288 00000100:00100000:2.0:1789135744.217721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.218132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512519296 00000100:00100000:1.0:1789135744.218142:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512519296 00000100:00100000:1.0:1789135744.218266:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 289 00000100:00100000:1.0:1789135744.218277:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:10221:x1876044512519296:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135744.218526:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+12:10221:x1876044512519296:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 250us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.218535:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 289 00000100:00100000:2.0:1789135744.225016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.225236:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512519424 00000100:00100000:1.0:1789135744.225258:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512519424 00000100:00100000:1.0:1789135744.225314:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 290 00000100:00100000:1.0:1789135744.225325:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+12:5620:x1876044512519424:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135744.225344:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135744.225363:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34bab000/0x5b09da6ee1ce41a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d355e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.225391:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34bab000/0x5b09da6ee1ce41a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d355e expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.225403:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34bab000/0x5b09da6ee1ce41a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d355e expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.225430:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab000, rc 0) 00000100:00100000:1.0:1789135744.225491:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512519424:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 168us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.225499:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 290 00000100:00100000:0.0:1789135744.228233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.228530:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512519552 00000100:00100000:1.0:1789135744.228539:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512519552 00000100:00100000:1.0:1789135744.228666:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 291 00000100:00100000:1.0:1789135744.228677:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512519552:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.228971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512519552:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 295us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.228979:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 291 00000100:00100000:2.0:1789135744.232683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.232898:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512519680 00000100:00100000:1.0:1789135744.233035:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512519680 00000100:00100000:1.0:1789135744.233511:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 292 00000100:00100000:1.0:1789135744.233522:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512519680:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.233789:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:5620:x1876044512519680:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 268us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.233797:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 292 00000100:00100000:2.0:1789135744.237760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.238225:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512519808 00000100:00100000:1.0:1789135744.238235:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512519808 00000100:00100000:1.0:1789135744.238288:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 293 00000100:00100000:1.0:1789135744.238297:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:10224:x1876044512519808:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135744.238803:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:10224:x1876044512519808:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 505us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.238823:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 293 00000100:00100000:0.0:1789135744.242113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135744.242307:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512519936 00000100:00100000:1.0:1789135744.242317:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512519936 00000100:00100000:1.0:1789135744.242383:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 294 00000100:00100000:1.0:1789135744.242393:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:10224:x1876044512519936:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135744.242638:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:10224:x1876044512519936:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 245us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.242647:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 294 00000100:00100000:2.0:1789135744.525666:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545064448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135744.525745:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.525984:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545064448 00000100:00100000:3.0:1789135744.525994:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545064448 00000100:00080000:0.0:1789135744.526961:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135744.527363:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789135744.527567:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545064448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135744.527618:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135744.529143:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545064448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1583us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.529156:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135744.529194:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545064448:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789135744.716251:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135744.716260:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adb01c80000 from 10 10000000:01000000:3.0:1789135744.716266:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135744.716314:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135744.716326:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135744.716336:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135744.716360:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545064576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135744.716438:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.716510:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3a30fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135744.716708:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545064576 00000100:00100000:1.0:1789135744.716716:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545064576 00000100:00100000:1.0:1789135744.716775:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789135744.716786:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+16:5834:x1876044545064576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135744.716800:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135744.716814:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34bab600/0x5b09da6ee1ce41b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce41ad expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.716836:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34bab600/0x5b09da6ee1ce41b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce41ad expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.716860:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34bab600/0x5b09da6ee1ce41b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce41ad expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.716869:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab600, rc 0) 00000100:00100000:1.0:1789135744.716918:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545064576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.716927:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00010000:00010000:0.0:1789135744.717058:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135744.717303:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545064576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135744.717320:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.717331:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135744.717398:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545064704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135744.717430:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.717462:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11b27b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135744.717680:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545064704 00000100:00100000:3.0:1789135744.717686:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545064704 00000100:00100000:3.0:1789135744.717720:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789135744.717728:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545064704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135744.717975:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545064704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.717982:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789135744.718336:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545064704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135744.718373:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545064832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135744.718416:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.718448:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11b27b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135744.718482:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545064832 00000100:00100000:3.0:1789135744.718487:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545064832 00000100:00100000:3.0:1789135744.718530:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789135744.718537:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545064832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135744.718691:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545064832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.718697:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789135744.720321:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545064832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135744.721090:0:12070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12070:1876044545064960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135744.721156:0:12070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.721201:0:12070:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11b27a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135744.721349:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545064960 00000100:00100000:1.0:1789135744.721355:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545064960 00000100:00100000:1.0:1789135744.721407:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789135744.721417:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:12070:x1876044545064960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.721622:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+17:12070:x1876044545064960:12345-0@lo:502:llog_process_th.0 Request processed in 206us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.721631:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789135744.721786:0:12070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12070:1876044545064960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135744.721812:0:12070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135744.721821:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135744.721823:0:12070:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789135744.721829:0:12070:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adb01c80000 00000020:00000080:2.0:1789135744.721832:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135744.721922:0:12070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12070:1876044545065088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135744.721956:0:12070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.721981:0:12070:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05527240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135744.722136:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545065088 00000100:00100000:1.0:1789135744.722142:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545065088 00000100:00100000:1.0:1789135744.722184:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789135744.722191:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:12070:x1876044545065088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.722332:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:12070:x1876044545065088:12345-0@lo:502:llog_process_th.0 Request processed in 141us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.722340:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789135744.723974:0:12070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12070:1876044545065088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135744.724020:0:12070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135744.724028:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135744.724035:0:12070:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789135744.724040:0:12070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789135744.724405:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789135744.724433:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135744.724443:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135744.724454:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135744.724464:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135744.724466:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc057f3800 from 10 10000000:01000000:3.0:1789135744.724469:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135744.724501:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135744.724509:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135744.724518:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135744.724539:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135744.724596:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.724639:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3a30f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.725975:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545065216 00000100:00100000:2.0:1789135744.725986:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545065216 00000100:00100000:2.0:1789135744.726055:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789135744.726079:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+17:5834:x1876044545065216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135744.726095:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135744.726113:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc340f2e00/0x5b09da6ee1ce41c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce41bb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.726139:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc340f2e00/0x5b09da6ee1ce41c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce41bb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.726149:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc340f2e00/0x5b09da6ee1ce41c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce41bb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.726157:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2e00, rc 0) 00000100:00100000:2.0:1789135744.726236:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545065216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.726243:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789135744.726403:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135744.726421:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.726430:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.726490:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.726523:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.726555:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc184ae3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135744.727106:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545065344 00000100:00100000:3.0:1789135744.727120:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545065344 00000100:00100000:3.0:1789135744.727155:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789135744.727174:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545065344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135744.728160:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545065344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 996us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.728180:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789135744.728442:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.728497:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.728552:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.728587:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc184ae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135744.728605:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545065472 00000100:00100000:1.0:1789135744.728610:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545065472 00000100:00100000:1.0:1789135744.728640:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789135744.728648:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545065472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.728804:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545065472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.728811:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789135744.728873:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.729057:0:12071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12071:1876044545065600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.729113:0:12071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.729132:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545065600 00000100:00100000:1.0:1789135744.729136:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545065600 00000100:00100000:1.0:1789135744.729152:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789135744.729158:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:12071:x1876044545065600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.729287:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:12071:x1876044545065600:12345-0@lo:502:llog_process_th.0 Request processed in 128us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.729293:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789135744.729326:0:12071:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc121783c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135744.729338:0:12071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12071:1876044545065600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135744.729358:0:12071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135744.729367:0:12071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135744.729369:0:12071:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789135744.729375:0:12071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc057f3800 00000020:00000080:1.0:1789135744.729384:0:12071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135744.729445:0:12071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12071:1876044545065728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.729476:0:12071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.729495:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545065728 00000100:00100000:1.0:1789135744.729498:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545065728 00000100:00100000:1.0:1789135744.729515:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789135744.729521:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:12071:x1876044545065728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.729617:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:12071:x1876044545065728:12345-0@lo:502:llog_process_th.0 Request processed in 95us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.729623:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789135744.729648:0:12071:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc121783c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135744.729658:0:12071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12071:1876044545065728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135744.729674:0:12071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135744.729678:0:12071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135744.729679:0:12071:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789135744.729682:0:12071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789135744.729726:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789135744.729741:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135744.729749:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.729759:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135744.729770:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135744.729772:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc10b30000 from 10 10000000:01000000:1.0:1789135744.729775:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135744.729797:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.729815:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.729824:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.729836:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.734514:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.734605:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc121783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.739479:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545065856 00000100:00100000:2.0:1789135744.739495:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545065856 00000100:00100000:1.0:1789135744.739650:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789135744.739660:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+18:5834:x1876044545065856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135744.739675:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135744.739691:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce41d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce41c9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.739717:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce41d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce41c9 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.739728:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce41d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce41c9 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.739736:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab400, rc 0) 00000100:00100000:1.0:1789135744.742051:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545065856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2385us (7534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.742077:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789135744.748269:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135744.748302:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135744.748315:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135744.748467:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135744.748526:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.748607:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3a30fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.754517:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545065984 00000100:00100000:2.0:1789135744.754532:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545065984 00000100:00100000:2.0:1789135744.756034:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789135744.756050:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545065984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.756506:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545065984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.756557:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545066112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.756612:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.757562:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545065984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (7841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.757574:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000040:00080000:0.0:1789135744.757713:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789135744.760348:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545066112 00000100:00100000:2.0:1789135744.760360:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545066112 00000100:00100000:2.0:1789135744.760398:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789135744.760407:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545066112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.763659:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12178900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.763670:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:5834:x1876044545066112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3259us (7053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.763683:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789135744.763693:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:45dd8677-45c4-4169-a65f-287162436408:5834:1876044545066112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135744.765621:0:12076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12076:1876044545066240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.765691:0:12076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.765726:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545066240 00000100:00100000:1.0:1789135744.765732:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545066240 00000100:00100000:1.0:1789135744.765770:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789135744.765779:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:12076:x1876044545066240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.766015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:12076:x1876044545066240:12345-0@lo:502:llog_process_th.0 Request processed in 235us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.766023:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789135744.766202:0:12076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12178780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135744.766225:0:12076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12076:1876044545066240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135744.766252:0:12076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135744.766261:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135744.766263:0:12076:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789135744.766270:0:12076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc10b30000 00000020:00000080:1.0:1789135744.766272:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135744.766402:0:12076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12076:1876044545066368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135744.766439:0:12076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.766458:0:12076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12178780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.766592:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545066368 00000100:00100000:2.0:1789135744.766598:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545066368 00000100:00100000:2.0:1789135744.766631:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789135744.766639:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:12076:x1876044545066368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135744.771455:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:12076:x1876044545066368:12345-0@lo:502:llog_process_th.0 Request processed in 4809us (5007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.771469:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789135744.771479:0:12076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:45dd8677-45c4-4169-a65f-287162436408:12076:1876044545066368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135744.771517:0:12076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135744.771525:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135744.771527:0:12076:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789135744.771532:0:12076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789135744.775218:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789135744.775387:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135744.775400:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.775413:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135745.742154:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135745.804731:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789135746.764339:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135747.788772:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135748.108815:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545066624:0@lo:400:kworker.0 00000100:00100000:1.0:1789135748.108869:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545066496:0@lo:400:kworker.0 00000100:00100000:2.0:1789135748.109523:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545066880:0@lo:400:kworker.0 00000100:00100000:1.0:1789135748.113028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135748.113874:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545067008:0@lo:400:kworker.0 00000100:00100000:1.0:1789135748.113936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135748.113992:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545067008 00000100:00100000:1.0:1789135748.113999:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545067008 00000100:00100000:1.0:1789135748.114058:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789135748.114084:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545067008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135748.114487:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789135748.114518:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135748.114530:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545066752:0@lo:400:kworker.0 00000100:00100000:0.0:1789135748.114647:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135748.114687:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545066624 00000100:00100000:0.0:1789135748.114691:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545066624 00000100:00100000:1.0:1789135748.114875:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545067008:12345-0@lo:400:kworker.0 Request processed in 792us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135748.114883:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135748.114883:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789135748.114907:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545066752 00000100:00100000:1.0:1789135748.114910:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545066752 00000100:00100000:2.0:1789135748.114921:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545066880 00000100:00100000:2.0:1789135748.114932:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545066880 00000100:00100000:1.0:1789135748.114938:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789135748.114943:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545066752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135748.114968:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135748.114975:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545066880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135748.114975:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545066752:12345-0@lo:400:kworker.0 Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135748.114981:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1789135748.114999:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135748.115002:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135748.115016:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545066496 00000100:00100000:1.0:1789135748.115019:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545066496 00000100:00100000:2.0:1789135748.115034:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545066880:12345-0@lo:400:kworker.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135748.115040:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789135748.115041:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789135748.115045:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545066496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135748.115101:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545066880:0@lo:400:kworker.0 00000100:00100000:1.0:1789135748.115568:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545066496:12345-0@lo:400:kworker.0 Request processed in 521us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135748.115576:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789135748.115613:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545066496:0@lo:400:kworker.0 00000100:00100000:1.0:1789135748.115625:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545067008:0@lo:400:kworker.0 00000100:00100000:1.0:1789135748.115671:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545066752:0@lo:400:kworker.0 00000100:00100000:0.0:1789135748.115717:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789135748.115725:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545066624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135748.115775:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545066624:12345-0@lo:400:kworker.0 Request processed in 44us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135748.115782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789135748.115845:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545066624:0@lo:400:kworker.0 00000100:00100000:0.0:1789135748.115854:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545067136:0@lo:400:kworker.0 00000100:00100000:0.0:1789135748.115888:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135748.116814:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545067136 00000100:00100000:2.0:1789135748.116822:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545067136 00000100:00100000:2.0:1789135748.116900:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789135748.116908:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545067136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135748.116974:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545067136:12345-0@lo:400:kworker.0 Request processed in 67us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135748.116980:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789135748.117040:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135748.117104:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3787e580 x1876044545067136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135748.117117:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545067136:0@lo:400:kworker.0 00000100:00100000:1.0:1789135748.621253:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545067264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135748.621362:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135748.621924:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545067264 00000100:00100000:0.0:1789135748.621944:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545067264 00000100:00100000:0.0:1789135748.622007:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789135748.622016:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545067264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135748.622133:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135748.624290:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545067264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2267us (2920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135748.624312:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1789135748.624614:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc194543c0 x1876044545067264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135748.624688:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545067264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135748.812309:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135749.045640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135749.045708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135749.045746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135749.045776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135749.045808:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512520192 00000100:00100000:2.0:1789135749.045817:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512520192 00000100:00100000:3.0:1789135749.045833:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512520320 00000100:00100000:3.0:1789135749.045840:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512520320 00000100:00100000:2.0:1789135749.045872:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512520448 00000100:00100000:2.0:1789135749.045875:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512520448 00000100:00100000:2.0:1789135749.045897:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 133 00000100:00100000:2.0:1789135749.045906:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512520192:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135749.045998:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:3.0:1789135749.046006:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512520320:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135749.046093:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512520320:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 55us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135749.046109:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00080000:3.0:1789135749.046381:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135749.046386:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135749.046409:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 134 00000100:00100000:3.0:1789135749.046417:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512520448:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135749.046446:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512520448:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135749.046452:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 134 00000100:00100000:1.0:1789135749.046861:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512520064 00000100:00100000:1.0:1789135749.046867:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512520064 00000100:00100000:1.0:1789135749.046902:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 311 00000100:00100000:1.0:1789135749.046910:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512520064:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135749.046946:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512520064:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 38us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135749.046953:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 311 00000100:00100000:2.0:1789135749.047194:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512520192:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 1288us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135749.047203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 133 00000100:00100000:0.0:1789135749.644461:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135749.644484:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545067392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135749.644885:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135749.645230:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545067392 00000100:00100000:2.0:1789135749.645238:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545067392 00000100:00100000:2.0:1789135749.645354:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789135749.645365:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545067392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135749.645402:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135749.645469:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545067392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135749.645477:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789135749.645570:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545067392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135749.836575:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135750.860292:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135751.884302:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135752.908732:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135753.230940:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc419503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545067904:0@lo:400:kworker.0 00000100:00100000:0.0:1789135753.231015:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545067520:0@lo:400:kworker.0 00000100:00100000:2.0:1789135753.231167:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135753.231220:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135753.231228:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545067776:0@lo:400:kworker.0 00000100:00100000:2.0:1789135753.231254:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135753.231285:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545067904 00000100:00100000:2.0:1789135753.231291:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545067904 00000100:00100000:2.0:1789135753.231355:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789135753.231366:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545067904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135753.231497:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545067904:12345-0@lo:400:kworker.0 Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135753.231507:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789135753.231540:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545067776 00000100:00100000:2.0:1789135753.231544:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545067776 00000100:00100000:2.0:1789135753.231574:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789135753.231582:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545067776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135753.231638:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135753.231657:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545067776:12345-0@lo:400:kworker.0 Request processed in 75us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135753.231666:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789135753.231667:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545067520 00000100:00100000:1.0:1789135753.231673:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545067520 00000100:00100000:0.0:1789135753.231686:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41951a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545068032:0@lo:400:kworker.0 00000100:00080000:2.0:1789135753.231691:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135753.231697:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135753.231712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789135753.231721:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545067520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135753.231744:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545067776:0@lo:400:kworker.0 00000100:00100000:2.0:1789135753.231760:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc419503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545067904:0@lo:400:kworker.0 00000100:00100000:1.0:1789135753.231774:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545067520:12345-0@lo:400:kworker.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135753.231781:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789135753.234183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135753.234248:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545067520:0@lo:400:kworker.0 00000100:00100000:0.0:1789135753.234263:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135753.234272:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545067648:0@lo:400:kworker.0 00000100:00100000:0.0:1789135753.234301:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135753.234320:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41953840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545068160:0@lo:400:kworker.0 00000100:00100000:0.0:1789135753.234349:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135753.234379:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545068160 00000100:00100000:3.0:1789135753.234386:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545068160 00000100:00100000:0.0:1789135753.234427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545068032 00000100:00100000:0.0:1789135753.234432:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545068032 00000100:00100000:3.0:1789135753.234437:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135753.234448:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545068160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135753.234468:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545067648 00000100:00100000:0.0:1789135753.234471:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545067648 00000100:00080000:2.0:1789135753.234481:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135753.234489:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135753.234496:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789135753.234506:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545068032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135753.234510:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789135753.234512:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545068160:12345-0@lo:400:kworker.0 Request processed in 64us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135753.234522:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789135753.234527:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41951680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545067648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135753.234555:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545068032:12345-0@lo:400:kworker.0 Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135753.234563:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789135753.234588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41951680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545067648:12345-0@lo:400:kworker.0 Request processed in 65us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135753.234595:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:3.0:1789135753.234850:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41953840 x1876044545068160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135753.234862:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41953840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545068160:0@lo:400:kworker.0 00000100:00100000:3.0:1789135753.234878:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41951a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545068032:0@lo:400:kworker.0 00000100:00100000:3.0:1789135753.234907:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545067648:0@lo:400:kworker.0 00000100:00100000:0.0:1789135753.740569:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545068288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135753.740644:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135753.740824:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545068288 00000100:00100000:1.0:1789135753.740832:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545068288 00000100:00100000:1.0:1789135753.740881:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789135753.740890:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545068288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135753.740920:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135753.740968:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545068288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135753.740975:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1789135753.741127:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc19454780 x1876044545068288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135753.741143:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545068288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135753.933866:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135754.163385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135754.163532:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512520576 00000100:00100000:1.0:1789135754.163541:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512520576 00000100:00100000:1.0:1789135754.163594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 313 00000100:00100000:1.0:1789135754.163604:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512520576:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135754.163754:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512520576:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 150us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135754.163909:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 313 00000100:00100000:3.0:1789135754.169713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135754.170050:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512520704 00000100:00100000:2.0:1789135754.170059:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512520704 00000100:00100000:2.0:1789135754.170174:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 138 00000100:00100000:2.0:1789135754.170184:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512520704:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135754.170256:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512520704:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 74us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135754.170269:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 138 00000100:00080000:0.0:1789135754.170564:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135754.176181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135754.176650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512520960 00000100:00100000:2.0:1789135754.176660:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512520960 00000100:00100000:2.0:1789135754.176739:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 139 00000100:00100000:2.0:1789135754.176748:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41951a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2375:x1876044512520960:12345-192.168.206.35@tcp:400:kworker.0 00000100:00080000:0.0:1789135754.176885:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135754.176982:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41951a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2375:x1876044512520960:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 234us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135754.176990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 139 00000100:00100000:3.0:1789135754.177584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135754.178516:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512520832 00000100:00100000:2.0:1789135754.178531:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512520832 00000100:00100000:2.0:1789135754.178591:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:2.0:1789135754.178598:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512520832:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135754.178705:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512520832:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 107us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135754.178714:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00080000:0.0:1789135754.178791:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135754.767318:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545068416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135754.767400:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135754.767557:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545068416 00000100:00100000:1.0:1789135754.767564:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545068416 00000100:00100000:1.0:1789135754.767611:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135754.767620:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545068416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135754.767654:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135754.767694:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545068416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135754.767701:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789135754.769057:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545068416:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135754.964754:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135755.020901:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789135755.983826:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135757.006895:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135758.028371:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135758.352406:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545068928:0@lo:400:kworker.0 00000100:00100000:2.0:1789135758.352481:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135758.352558:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135758.352565:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bcbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545068800:0@lo:400:kworker.0 00000100:00100000:2.0:1789135758.352590:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135758.352622:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545068800 00000100:00100000:2.0:1789135758.352629:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545068800 00000100:00100000:2.0:1789135758.352692:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789135758.352710:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545068800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135758.352775:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545068800:12345-0@lo:400:kworker.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135758.352783:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789135758.352824:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bcbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545068800:0@lo:400:kworker.0 00000100:00100000:3.0:1789135758.353611:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545068544:0@lo:400:kworker.0 00000100:00100000:3.0:1789135758.353652:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135758.353713:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545069056:0@lo:400:kworker.0 00000100:00100000:3.0:1789135758.353738:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135758.354032:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545069056 00000100:00100000:1.0:1789135758.354038:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545069056 00000100:00100000:1.0:1789135758.354109:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789135758.354117:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545069056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135758.354155:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545069056:12345-0@lo:400:kworker.0 Request processed in 40us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135758.354174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789135758.354226:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545068928 00000100:00100000:1.0:1789135758.354230:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545068928 00000100:00100000:1.0:1789135758.354255:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789135758.354260:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545068928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135758.354296:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545068928:12345-0@lo:400:kworker.0 Request processed in 36us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135758.354302:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789135758.354329:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545068928:0@lo:400:kworker.0 00000100:00100000:3.0:1789135758.354489:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545069056:0@lo:400:kworker.0 00000100:00100000:3.0:1789135758.354511:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789135758.354519:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545068672:0@lo:400:kworker.0 00000100:00100000:3.0:1789135758.354544:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135758.354573:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545069184:0@lo:400:kworker.0 00000100:00100000:3.0:1789135758.354604:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135758.354629:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545069184 00000100:00100000:3.0:1789135758.354633:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545069184 00000100:00100000:3.0:1789135758.354658:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789135758.354663:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545069184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135758.354721:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545069184:12345-0@lo:400:kworker.0 Request processed in 58us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135758.354727:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1789135758.354755:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34bcb480 x1876044545069184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135758.354778:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545069184:0@lo:400:kworker.0 00000100:00100000:2.0:1789135758.356154:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545068544 00000100:00100000:2.0:1789135758.356164:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545068544 00000100:00100000:2.0:1789135758.356214:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789135758.356234:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545068544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135758.356289:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545068544:12345-0@lo:400:kworker.0 Request processed in 57us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135758.356295:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:0.0:1789135758.356406:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135758.356411:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135758.356414:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135758.357048:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545068544:0@lo:400:kworker.0 00000100:00100000:1.0:1789135758.359287:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545068672 00000100:00100000:1.0:1789135758.359299:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545068672 00000100:00100000:1.0:1789135758.359380:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135758.359389:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545068672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135758.359485:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545068672:12345-0@lo:400:kworker.0 Request processed in 97us (4940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135758.359492:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789135758.361464:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545068672:0@lo:400:kworker.0 00000100:00100000:1.0:1789135758.860587:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545069312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135758.860656:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135758.860818:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545069312 00000100:00100000:0.0:1789135758.860825:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545069312 00000100:00100000:0.0:1789135758.860877:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789135758.860886:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545069312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135758.860928:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135758.860983:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545069312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135758.860991:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1789135758.861307:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41bfb0c0 x1876044545069312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135758.861325:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545069312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789135759.052416:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135759.291026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135759.291220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135759.291299:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512521216 00000100:00100000:3.0:1789135759.291308:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512521216 00000100:00100000:3.0:1789135759.291380:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 143 00000100:00100000:3.0:1789135759.291390:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512521216:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135759.291460:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512521216:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135759.291468:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 143 00000100:00080000:0.0:1789135759.291555:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135759.291640:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512521088 00000100:00100000:2.0:1789135759.291645:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512521088 00000100:00100000:2.0:1789135759.291682:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 315 00000100:00100000:2.0:1789135759.291688:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512521088:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135759.291714:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512521088:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135759.291721:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 315 00000100:00100000:3.0:1789135759.309236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135759.309276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135759.309389:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512521344 00000100:00100000:1.0:1789135759.309398:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512521344 00000100:00100000:1.0:1789135759.309471:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:1.0:1789135759.309481:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2374:x1876044512521344:12345-192.168.206.35@tcp:9:kworker.0 00000020:00000080:1.0:1789135759.309506:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce410c 00000100:00080000:1.0:1789135759.309514:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8adc41913000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135759.309546:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789135759.309792:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+2:2374:x1876044512521344:12345-192.168.206.35@tcp:9:kworker.0 Request processed in 312us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.309801:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00010000:00010000:1.0:1789135759.309920:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789135759.311019:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135759.312889:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512521472 00000100:00100000:0.0:1789135759.312900:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512521472 00000100:00100000:0.0:1789135759.313114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 144 00000100:00100000:0.0:1789135759.313124:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512521472:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135759.313205:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2378:x1876044512521472:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 83us (3928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.313212:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 144 00000100:00080000:2.0:1789135759.317479:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135759.888935:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545069440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135759.889000:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.890216:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545069440 00000100:00100000:1.0:1789135759.890224:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545069440 00000100:00100000:1.0:1789135759.892617:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789135759.892638:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545069440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135759.892673:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135759.892754:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545069440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.892761:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789135759.893685:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545069440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135760.087407:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135761.105636:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135762.124381:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135763.003312:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:0.0:1789135763.003332:0:6705:0:(genops.c:885:class_export_put()) final put ffff8adc057f4000/5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:2.0:1789135763.003566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc057f4000/5f7ef768-1508-4eda-9824-c10078b0a61e for lustre-OST0000 00000020:00000080:2.0:1789135763.003612:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc41913000 for lustre-OST0000 00010000:00010000:0.0:1789135763.148313:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135763.468230:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545069568:0@lo:400:kworker.0 00000100:00100000:2.0:1789135763.468249:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545069824:0@lo:400:kworker.0 00000100:00100000:1.0:1789135763.468307:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545069696:0@lo:400:kworker.0 00000100:00100000:3.0:1789135763.472310:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135763.472310:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135763.472373:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135763.472384:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545069952:0@lo:400:kworker.0 00000100:00100000:1.0:1789135763.472408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135763.472413:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135763.472437:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545070208:0@lo:400:kworker.0 00000100:00100000:2.0:1789135763.472457:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545069824 00000100:00100000:1.0:1789135763.472457:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135763.472463:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545069824 00000100:00100000:1.0:1789135763.472476:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135763.472480:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545070080:0@lo:400:kworker.0 00000100:00100000:1.0:1789135763.472499:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135763.472516:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545069696 00000100:00100000:2.0:1789135763.472519:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545069696 00000100:00100000:1.0:1789135763.472526:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545070080 00000100:00100000:1.0:1789135763.472535:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545070080 00000100:00100000:2.0:1789135763.472539:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789135763.472545:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545069824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135763.472553:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789135763.472557:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545069696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135763.472593:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545069824:12345-0@lo:400:kworker.0 Request processed in 47us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135763.472593:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545069696:12345-0@lo:400:kworker.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135763.472601:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135763.472604:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789135763.472616:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135763.472629:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545069952 00000100:00100000:2.0:1789135763.472633:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545069952 00000100:00100000:3.0:1789135763.472725:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545069568 00000100:00100000:3.0:1789135763.472729:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545069568 00000100:00100000:3.0:1789135763.472754:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789135763.472761:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545069568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135763.472863:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545069568:12345-0@lo:400:kworker.0 Request processed in 103us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135763.472869:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789135763.472923:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545069568:0@lo:400:kworker.0 00000100:00100000:1.0:1789135763.473026:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545070080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789135763.473219:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135763.473224:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135763.473397:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545070080:12345-0@lo:400:kworker.0 Request processed in 775us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135763.473404:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789135763.473432:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545070208 00000100:00100000:1.0:1789135763.473436:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545070208 00000100:00100000:1.0:1789135763.473506:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789135763.473512:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545070208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135763.473541:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545070208:12345-0@lo:400:kworker.0 Request processed in 30us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135763.473547:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789135763.473591:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545070080:0@lo:400:kworker.0 00000100:00100000:1.0:1789135763.473601:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545069696:0@lo:400:kworker.0 00010000:00080000:1.0:1789135763.473613:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34bcb480 x1876044545070208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135763.473635:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545070208:0@lo:400:kworker.0 00000100:00100000:2.0:1789135763.473670:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789135763.473679:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545069952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135763.473713:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545069952:12345-0@lo:400:kworker.0 Request processed in 36us (1299us total) trans 0 rc 0/0 00000100:00080000:3.0:1789135763.473746:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135763.474111:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789135763.474145:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545069952:0@lo:400:kworker.0 00000100:00100000:2.0:1789135763.474156:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545069824:0@lo:400:kworker.0 00000100:00100000:2.0:1789135763.983980:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545070336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135763.984050:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135763.984399:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545070336 00000100:00100000:3.0:1789135763.984407:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545070336 00000100:00100000:3.0:1789135763.984462:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789135763.984472:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545070336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135763.984510:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135763.984560:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545070336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135763.984568:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1789135763.986336:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d03c0 x1876044545070336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135763.986362:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545070336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135764.175546:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135764.405026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135764.405172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135764.405220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135764.405250:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512521856 00000100:00100000:1.0:1789135764.405258:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512521856 00000100:00100000:1.0:1789135764.405311:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512521728 00000100:00100000:1.0:1789135764.405315:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512521728 00000100:00100000:1.0:1789135764.405338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 148 00000100:00100000:1.0:1789135764.405346:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512521856:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135764.405414:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512521856:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 68us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.405421:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 148 00000100:00100000:1.0:1789135764.405446:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 149 00000100:00100000:1.0:1789135764.405453:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a355a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512521728:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135764.405479:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a355a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512521728:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.405485:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 149 00000100:00080000:1.0:1789135764.405501:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135764.405529:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512521600 00000100:00100000:2.0:1789135764.405535:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512521600 00000100:00100000:2.0:1789135764.405572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 317 00000100:00100000:2.0:1789135764.405581:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512521600:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135764.405621:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512521600:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 42us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135764.405629:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 317 00000100:00100000:2.0:1789135765.004599:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545070464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135765.004663:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135765.004773:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545070464 00000100:00100000:3.0:1789135765.004779:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545070464 00000100:00100000:3.0:1789135765.005623:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789135765.005634:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545070464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135765.005666:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135765.005932:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545070464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 300us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135765.005940:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789135765.006004:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545070464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789135765.008346:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789135765.198403:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135765.260677:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789135766.221591:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135767.245336:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789135767.882934:0:12235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:09:25 (1789135765) 00010000:00010000:1.0:1789135768.275358:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135768.588333:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545070848:0@lo:400:kworker.0 00000100:00100000:2.0:1789135768.588403:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135768.588455:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135768.588461:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545070976:0@lo:400:kworker.0 00000100:00100000:2.0:1789135768.588483:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135768.588654:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545070720:0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.588683:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135768.588707:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545071232:0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.588739:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135768.588759:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789135768.588765:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545070592:0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.588791:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135768.588823:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545071104:0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.588846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135768.588872:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545070848 00000100:00100000:1.0:1789135768.588879:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545070848 00000100:00100000:1.0:1789135768.588924:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545070720 00000100:00100000:1.0:1789135768.588927:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545070720 00000100:00100000:1.0:1789135768.588940:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545071104 00000100:00100000:1.0:1789135768.588942:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545071104 00000100:00100000:1.0:1789135768.588956:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789135768.588962:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545070848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.589018:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545070848:12345-0@lo:400:kworker.0 Request processed in 55us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135768.589025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789135768.589078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789135768.589084:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545070720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.589112:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545070720:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135768.589118:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789135768.589129:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789135768.589134:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545071104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.589156:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545071104:12345-0@lo:400:kworker.0 Request processed in 21us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135768.589162:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789135768.589181:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545070976 00000100:00100000:1.0:1789135768.589184:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545070976 00000100:00100000:1.0:1789135768.589204:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545071232 00000100:00100000:1.0:1789135768.589206:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545071232 00000100:00100000:1.0:1789135768.589221:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789135768.589234:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545070976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.589266:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545070976:12345-0@lo:400:kworker.0 Request processed in 33us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135768.589271:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789135768.589286:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789135768.589303:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545071232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.589328:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545071232:12345-0@lo:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135768.589333:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789135768.589389:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545070976:0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.589400:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545070848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.589429:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545071104:0@lo:400:kworker.0 00000100:00100000:1.0:1789135768.589437:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545070720:0@lo:400:kworker.0 00010000:00080000:1.0:1789135768.589447:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc3787d2c0 x1876044545071232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135768.589457:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545071232:0@lo:400:kworker.0 00000100:00100000:2.0:1789135768.589930:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545070592 00000100:00100000:2.0:1789135768.589936:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545070592 00000100:00100000:2.0:1789135768.589977:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789135768.589985:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545070592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135768.590044:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545070592:12345-0@lo:400:kworker.0 Request processed in 49us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135768.590050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789135768.590107:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545070592:0@lo:400:kworker.0 00000100:00080000:0.0:1789135768.590662:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135768.590667:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135768.590670:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135769.101868:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135769.101890:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545071360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135769.101968:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135769.103670:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545071360 00000100:00100000:3.0:1789135769.103681:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545071360 00000100:00100000:3.0:1789135769.103752:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789135769.103762:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a26e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545071360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135769.103797:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135769.103875:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a26e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545071360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135769.103883:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1789135769.104671:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc345d2d00 x1876044545071360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135769.104701:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545071360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135769.294111:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135769.527643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135769.527687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135769.527723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135769.527818:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512522240 00000100:00100000:1.0:1789135769.527828:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512522240 00000100:00100000:1.0:1789135769.527892:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512522112 00000100:00100000:1.0:1789135769.527895:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512522112 00000100:00100000:1.0:1789135769.527932:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 153 00000100:00100000:1.0:1789135769.527949:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2375:x1876044512522240:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135769.528037:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2375:x1876044512522240:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135769.528057:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 153 00000100:00100000:1.0:1789135769.528110:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 154 00000100:00100000:1.0:1789135769.528118:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512522112:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135769.528146:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512522112:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135769.528152:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 154 00000100:00100000:2.0:1789135769.528442:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512521984 00000100:00100000:2.0:1789135769.528448:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512521984 00000100:00100000:2.0:1789135769.528492:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 319 00000100:00100000:2.0:1789135769.528499:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2375:x1876044512521984:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135769.528533:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2375:x1876044512521984:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 34us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135769.528539:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 319 00000100:00080000:3.0:1789135769.528800:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135770.126679:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135770.126703:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545071488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135770.126771:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135770.127115:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545071488 00000100:00100000:3.0:1789135770.127134:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545071488 00000100:00100000:3.0:1789135770.128141:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789135770.128156:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545071488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135770.128194:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135770.128260:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545071488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135770.128267:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789135770.128404:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545071488:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789135770.128487:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135770.291352:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135770.291999:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512522368 00000100:00100000:0.0:1789135770.292008:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512522368 00000100:00100000:0.0:1789135770.292123:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:0.0:1789135770.292134:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:10494:x1876044512522368:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135770.292153:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135770.292219:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce41d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3565 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135770.292323:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce41de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135770.292335:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce41de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135770.292346:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce41de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135770.292514:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789135770.292518:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135770.292780:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce41de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135770.292807:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce41d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3565 expref: 7 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135770.292825:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce41de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3565 expref: 6 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135770.292834:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc062d3700) 00010000:00010000:0.0:1789135770.292837:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135770.292944:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045a00, rc 0) 00000100:00100000:0.0:1789135770.293016:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:10494:x1876044512522368:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 884us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135770.293033:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:1.0:1789135770.303058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135770.303109:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512522496 00000100:00100000:1.0:1789135770.303116:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512522496 00000100:00100000:1.0:1789135770.303160:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:1.0:1789135770.303169:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+6:10495:x1876044512522496:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135770.303186:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135770.303208:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34babc00/0x5b09da6ee1ce41e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d356c expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303265:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303291:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303303:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303318:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303338:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303345:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303759:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab800/0x5b09da6ee1ce41fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303769:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab800/0x5b09da6ee1ce41fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.303776:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab800/0x5b09da6ee1ce41fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135770.304972:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789135770.304978:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135770.305125:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab800/0x5b09da6ee1ce41fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305139:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305145:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305151:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305157:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baaa00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135770.305161:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305175:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305189:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc062d3700) 00010000:00010000:1.0:1789135770.305192:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135770.305196:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305202:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce41ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305215:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305219:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305224:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305229:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135770.305232:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305237:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305244:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8adc1953ca00) 00010000:00010000:1.0:1789135770.305246:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135770.305248:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.305262:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce41f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.306010:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34babc00/0x5b09da6ee1ce41e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d356c expref: 8 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.306038:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab800/0x5b09da6ee1ce41fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d356c expref: 7 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.306045:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8adc1953cc00) 00010000:00010000:1.0:1789135770.306048:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135770.306050:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab800, rc 0) 00000100:00100000:1.0:1789135770.306137:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+7:10495:x1876044512522496:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2968us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135770.306146:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:2.0:1789135770.311008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135770.311561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512522752 00000100:00100000:1.0:1789135770.311570:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512522752 00000100:00100000:1.0:1789135770.311630:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:1.0:1789135770.311640:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:10495:x1876044512522752:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135770.311660:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135770.311678:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa200/0x5b09da6ee1ce4201 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.311758:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.311773:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.311796:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.312147:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.312157:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.312165:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313207:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480800/0x5b09da6ee1ce4216 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313220:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480800/0x5b09da6ee1ce4216 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313229:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480800/0x5b09da6ee1ce4216 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135770.313240:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789135770.313452:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313459:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313466:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313472:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baa400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135770.313483:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313492:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313515:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8adc1953cc00) 00010000:00010000:1.0:1789135770.313519:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135770.313523:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313530:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa400/0x5b09da6ee1ce4208 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313542:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313549:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313554:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313560:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baa000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135770.313563:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313569:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313576:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8adc1953c200) 00010000:00010000:1.0:1789135770.313578:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135770.313587:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.313593:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa000/0x5b09da6ee1ce420f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135770.317937:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135770.324981:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baa200/0x5b09da6ee1ce4201 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3573 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.325018:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480800/0x5b09da6ee1ce4216 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3573 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135770.325036:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:1.0:1789135770.325039:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135770.325043:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480800, rc 0) 00000100:00100000:1.0:1789135770.326622:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:10495:x1876044512522752:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 14977us (15625us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789135770.326634:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:3.0:1789135770.360424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135770.360716:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512522880 00000100:00100000:1.0:1789135770.360730:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512522880 00000100:00100000:1.0:1789135770.360788:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:1.0:1789135770.360798:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+9:10495:x1876044512522880:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789135770.360894:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+9:10495:x1876044512522880:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 Request processed in 97us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135770.360902:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00000040:00080000:1.0:1789135770.381425:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789135771.340533:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135772.364424:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789135772.766730:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:2.0:1789135773.180389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135773.180460:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512523008 00000100:00100000:3.0:1789135773.180469:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512523008 00000100:00100000:3.0:1789135773.180533:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:3.0:1789135773.180542:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+8:10537:x1876044512523008:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135773.180560:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135773.180576:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d357a expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.180640:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.180654:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.180667:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.180680:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.180687:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.180701:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181145:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181152:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181159:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181164:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135773.181168:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181174:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181185:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc062d3700) 00010000:00010000:3.0:1789135773.181188:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135773.181192:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181197:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce422b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181207:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181212:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181224:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181230:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135773.181233:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181239:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181247:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8adc02cc5600) 00010000:00010000:3.0:1789135773.181249:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135773.181252:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181257:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181288:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4224 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d357a expref: 9 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181297:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc062d3700) 00010000:00010000:3.0:1789135773.181300:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135773.181304:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d357a expref: 9 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.181312:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31fc00, rc 0) 00000100:00100000:3.0:1789135773.181366:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+8:10537:x1876044512523008:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 825us (984us total) trans 0 rc 301/301 00000100:00100000:3.0:1789135773.181382:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00080000:0.0:1789135773.186730:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135773.187839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135773.187868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512523264 00000100:00100000:3.0:1789135773.187878:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512523264 00000100:00100000:3.0:1789135773.187925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:3.0:1789135773.187934:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:10537:x1876044512523264:12345-192.168.206.35@tcp:36:lfs.0 00010000:00010000:3.0:1789135773.188184:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135773.188211:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce41de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3565 expref: 8 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.188226:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc062d3700) 00010000:00010000:3.0:1789135773.188235:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135773.188493:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.188506:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.188516:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.188527:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.188534:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.188540:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135773.189769:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789135773.189783:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.189791:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.195332:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.195343:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135773.195348:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.195357:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.195371:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:3.0:1789135773.195374:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135773.195378:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.195384:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4239 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135773.195405:0:5838:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009a3a6939 reply state 00000000503c8505 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135773.195413:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135773.197154:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:10537:x1876044512523264:12345-192.168.206.35@tcp:36:lfs.0 Request processed in 9212us (9311us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789135773.197176:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00010000:00010000:0.0:1789135773.211312:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.211329:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.211337:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.211343:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ea00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135773.211347:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.211355:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.211369:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8adc02cc5b00) 00010000:00010000:0.0:1789135773.211372:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135773.211376:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.211382:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4240 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135773.275094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135773.276313:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512523392 00000100:00100000:3.0:1789135773.276324:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512523392 00000100:00100000:3.0:1789135773.276380:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:3.0:1789135773.276390:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41953840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+8:10545:x1876044512523392:12345-192.168.206.35@tcp:101:lctl.0 00010000:00010000:3.0:1789135773.276411:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135773.276431:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4247 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3581 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.276489:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce424e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.276502:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce424e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.276513:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce424e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135773.276567:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789135773.276572:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135773.276633:0:5837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce424e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.276656:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4247 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3581 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.276673:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce424e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3581 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.276693:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:3.0:1789135773.276697:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135773.276700:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31fc00, rc 0) 00000100:00100000:3.0:1789135773.276768:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41953840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+9:10545:x1876044512523392:12345-192.168.206.35@tcp:101:lctl.0 Request processed in 377us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135773.276776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1789135773.387329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135773.389270:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512523520 00000100:00100000:2.0:1789135773.389284:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512523520 00000100:00100000:2.0:1789135773.389352:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:2.0:1789135773.389364:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41951e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+9:10551:x1876044512523520:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1789135773.389383:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135773.389402:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3588 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389463:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389477:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389488:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389501:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389522:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389528:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389626:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce426a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389634:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce426a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389641:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce426a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135773.389670:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789135773.389673:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135773.389710:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce426a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389721:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389727:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389734:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389739:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135773.389743:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389755:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389767:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:2.0:1789135773.389770:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135773.389774:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389780:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce425c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389792:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389797:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389802:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389806:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135773.389809:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389814:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389820:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8adc1171ac00) 00010000:00010000:2.0:1789135773.389823:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135773.389825:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389840:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4263 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389870:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3588 expref: 11 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389884:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce426a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3588 expref: 10 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.389890:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135773.389892:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789135773.389894:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2200, rc 0) 00000100:00100000:2.0:1789135773.392357:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41951e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+10:10551:x1876044512523520:12345-192.168.206.35@tcp:101:bash.0 Request processed in 2986us (5025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.392370:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00010000:00010000:1.0:1789135773.392476:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135773.407432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135773.409300:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512523776 00000100:00100000:1.0:1789135773.409314:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512523776 00000100:00100000:1.0:1789135773.409377:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:1.0:1789135773.409387:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+10:10551:x1876044512523776:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135773.409406:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135773.409426:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4271 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d358f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.409545:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.409558:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.409569:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.409640:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.409648:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.409655:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135773.411902:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789135773.412954:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.412982:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.413016:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.413054:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.413720:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.413728:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.413735:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135773.413739:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.413748:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.413761:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135773.413764:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135773.413769:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.413776:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4278 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135773.413791:0:5836:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000dbc283c5 reply state 00000000618aa61b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135773.413800:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789135773.413847:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4271 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.414521:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.414530:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135773.414533:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135773.414535:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481400, rc 0) 00000100:00100000:1.0:1789135773.415360:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+13:10551:x1876044512523776:12345-192.168.206.35@tcp:101:bash.0 Request processed in 5970us (7932us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789135773.415371:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00010000:00010000:3.0:1789135773.423473:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.423489:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.423498:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.423504:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135773.423508:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.423515:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.423531:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1953c200) 00010000:00010000:3.0:1789135773.423534:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135773.423538:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.423545:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce427f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135773.427552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135773.427653:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512523904 00000100:00100000:1.0:1789135773.427662:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512523904 00000100:00100000:1.0:1789135773.427710:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:1.0:1789135773.427718:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1876044512523904:12345-192.168.206.35@tcp:8:bash.0 00010000:00080000:1.0:1789135773.427752:0:6681:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:1.0:1789135773.427790:0:6681:0:(genops.c:1385:class_connect()) connect: client 5f7ef768-1508-4eda-9824-c10078b0a61e, cookie 0x5b09da6ee1ce4294 00002000:00100000:1.0:1789135773.427800:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5f7ef768-1508-4eda-9824-c10078b0a61e/ffff8adc02b93800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789135773.427821:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789135773.428098:0:6681:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789135773.428132:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8adc02b92800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135773.428189:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2374:x1876044512523904:12345-192.168.206.35@tcp:8:bash.0 Request processed in 470us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135773.428198:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:1.0:1789135773.439972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135773.440139:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512524032 00000100:00100000:2.0:1789135773.440148:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512524032 00000100:00100000:2.0:1789135773.440225:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:2.0:1789135773.440240:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:0:x1876044512524032:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1789135773.440257:0:6765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135773.440278:0:6765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3596 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135773.440304:0:6765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135773.440321:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1789135773.440326:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135773.440346:0:6765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 7 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.440367:0:6765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 7 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.440380:0:6765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3800, rc 0) 00000100:00100000:2.0:1789135773.440439:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:0:x1876044512524032:12345-192.168.206.35@tcp:101:bash.0 Request processed in 205us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.440446:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00080000:0.0:1789135773.440692:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135773.446526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135773.446619:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512524160 00000100:00100000:1.0:1789135773.446641:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512524160 00000100:00100000:1.0:1789135773.446697:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:1.0:1789135773.446707:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:10551:x1876044512524160:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135773.446724:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135773.446743:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d359d expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.446771:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 8 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.446778:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135773.446783:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135773.446787:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.446818:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 8 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.446831:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 8 pid: 6765 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135773.446845:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a301680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876044545071616:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135773.446934:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fcaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135773.459824:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a301680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876044545071616:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135773.459860:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.459881:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480a00, rc 0) 00000100:00100000:3.0:1789135773.460384:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+8:10551:x1876044512524160:12345-192.168.206.35@tcp:101:bash.0 Request processed in 13676us (13863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135773.460395:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:3.0:1789135773.482637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135773.486142:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512524288 00000100:00100000:2.0:1789135773.486163:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512524288 00010000:00010000:2.0:1789135773.486215:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 8 pid: 6765 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135773.486252:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:2.0:1789135773.486262:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512524288:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135773.486277:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135773.486298:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 8 pid: 6765 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.486332:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 8 pid: 6765 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.486355:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce429b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3596 expref: 8 pid: 6765 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.486372:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135773.486377:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135773.486385:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.486396:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.486434:0:8444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135773.486449:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8444:1876044545071744:192.168.206.35@tcp:105: 00000100:00100000:2.0:1789135773.486537:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3a30f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135773.492365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135773.492492:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8444:1876044545071744:192.168.206.35@tcp:105: 00010000:00010000:2.0:1789135773.492518:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135773.492570:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512524288:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 6310us (9943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.492580:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:1.0:1789135773.492730:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512524544 00000100:00100000:1.0:1789135773.492737:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512524544 00000100:00100000:1.0:1789135773.492783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:1.0:1789135773.492792:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+12:10551:x1876044512524544:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:1.0:1789135773.493146:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:10551:x1876044512524544:12345-192.168.206.35@tcp:35:bash.0 Request processed in 354us (790us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789135773.493324:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:1.0:1789135773.685155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135773.685250:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512524800 00000100:00100000:3.0:1789135773.685259:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512524800 00000100:00100000:3.0:1789135773.685320:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:3.0:1789135773.685331:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+13:10561:x1876044512524800:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135773.685355:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135773.685375:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce42a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35a4 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135773.685483:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789135773.685601:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce42a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35a4 expref: 15 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.685614:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:3.0:1789135773.685617:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135773.685621:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce42a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35a4 expref: 15 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.685635:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f000, rc 0) 00000100:00100000:3.0:1789135773.686497:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+14:10561:x1876044512524800:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1165us (1347us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789135773.686506:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:3.0:1789135773.705545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135773.705652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512525056 00000100:00100000:1.0:1789135773.705661:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512525056 00000100:00100000:1.0:1789135773.705716:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1789135773.705727:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+14:10561:x1876044512525056:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1789135773.706233:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+15:10561:x1876044512525056:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 506us (696us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789135773.706241:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1789135773.708404:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545071872:0@lo:400:kworker.0 00000100:00100000:0.0:1789135773.708491:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.708552:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545072384:0@lo:400:kworker.0 00000100:00100000:0.0:1789135773.708580:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.708616:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135773.708622:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545072000:0@lo:400:kworker.0 00000100:00100000:0.0:1789135773.708646:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.708665:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545072512:0@lo:400:kworker.0 00000100:00100000:0.0:1789135773.708690:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.708716:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545072256:0@lo:400:kworker.0 00000100:00100000:0.0:1789135773.708740:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.708760:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135773.708766:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545072128:0@lo:400:kworker.0 00000100:00100000:0.0:1789135773.708788:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135773.708817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545072384 00000100:00100000:0.0:1789135773.708823:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545072384 00000100:00100000:0.0:1789135773.708865:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545072000 00000100:00100000:0.0:1789135773.708869:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545072000 00000100:00100000:0.0:1789135773.708886:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545072128 00000100:00100000:0.0:1789135773.708888:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545072128 00000100:00100000:0.0:1789135773.709152:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789135773.709161:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545072384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135773.709210:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545072384:12345-0@lo:400:kworker.0 Request processed in 52us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135773.709217:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789135773.709233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789135773.709238:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545072000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135773.709377:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789135773.709391:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545072128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135773.709452:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545071872 00000100:00100000:3.0:1789135773.709456:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545071872 00000100:00100000:3.0:1789135773.709485:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789135773.709492:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545071872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135773.709680:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545072384:0@lo:400:kworker.0 00000100:00100000:1.0:1789135773.716894:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545072512 00000100:00100000:1.0:1789135773.716922:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545072512 00000100:00100000:1.0:1789135773.716991:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545072256 00000100:00100000:1.0:1789135773.716995:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545072256 00000100:00100000:1.0:1789135773.717040:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789135773.717049:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545072512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135773.717412:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789135773.717427:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545072256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135773.717498:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545072256:12345-0@lo:400:kworker.0 Request processed in 78us (8757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.717506:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789135773.717557:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545072128:12345-0@lo:400:kworker.0 Request processed in 8172us (8768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.717565:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789135773.717651:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545072128:0@lo:400:kworker.0 00000100:00100000:2.0:1789135773.717664:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545072256:0@lo:400:kworker.0 00000100:00080000:3.0:1789135773.718368:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135773.718373:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135773.718376:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135773.721831:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3313:x1876044545071872:12345-0@lo:400:kworker.0 Request processed in 12330us (13331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.721846:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789135773.722232:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545071872:0@lo:400:kworker.0 00000100:00100000:0.0:1789135773.728864:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545072000:12345-0@lo:400:kworker.0 Request processed in 19616us (20207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135773.728878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789135773.729302:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545072000:0@lo:400:kworker.0 00000100:00100000:1.0:1789135773.738233:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545072512:12345-0@lo:400:kworker.0 Request processed in 21176us (29533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135773.738249:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789135773.738561:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545072512:0@lo:400:kworker.0 00000100:00100000:1.0:1789135773.852179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135773.856354:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512525184 00000100:00100000:2.0:1789135773.856366:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512525184 00000100:00100000:2.0:1789135773.856440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:2.0:1789135773.856451:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+15:10567:x1876044512525184:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135773.856474:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135773.856492:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce42b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.856571:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce42be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.856584:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce42be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.856597:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce42be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135773.856648:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789135773.856652:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135773.856675:0:5836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce42be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.856700:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce42b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ab expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.856717:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce42be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ab expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.856725:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135773.856727:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135773.856730:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2600, rc 0) 00000100:00100000:2.0:1789135773.856804:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+16:10567:x1876044512525184:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 355us (4632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135773.856812:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:3.0:1789135773.867410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135773.867496:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512525440 00000100:00100000:1.0:1789135773.867504:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512525440 00000100:00100000:1.0:1789135773.867558:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:1.0:1789135773.867567:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+16:10567:x1876044512525440:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135773.867608:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135773.867628:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce42c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35b2 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.867719:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce42cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.867732:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce42cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.867743:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce42cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135773.867753:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789135773.867865:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce42c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35b2 expref: 19 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.867883:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce42cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35b2 expref: 18 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.867891:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135773.867894:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135773.867898:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481a00, rc 0) 00000100:00100000:1.0:1789135773.867977:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+18:10567:x1876044512525440:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 410us (575us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789135773.867984:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:3.0:1789135773.878789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135773.878831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135773.878909:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512525824 00000100:00100000:0.0:1789135773.878918:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512525824 00000100:00100000:1.0:1789135773.878957:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512525568 00000100:00100000:1.0:1789135773.878961:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512525568 00000100:00100000:0.0:1789135773.878985:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:0.0:1789135773.878995:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10567:x1876044512525824:12345-192.168.206.35@tcp:101:lfs.0 00000100:00100000:1.0:1789135773.879017:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00010000:00010000:0.0:1789135773.879024:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789135773.879036:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+19:2375:x1876044512525568:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135773.879040:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35b9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.879047:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135773.879087:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce42cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35b2 expref: 20 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135773.879103:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135773.879107:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135773.879145:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce42e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135773.879154:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+19:2375:x1876044512525568:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 119us (373us total) trans 0 rc 0/0 00010000:00010000:0.0:1789135773.879157:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce42e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135773.879161:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00010000:00010000:0.0:1789135773.879167:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce42e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135773.879177:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789135773.879283:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35b9 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.879298:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce42e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35b9 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135773.879305:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:0.0:1789135773.879307:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789135773.879316:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045400, rc 0) 00000100:00100000:0.0:1789135773.879354:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10567:x1876044512525824:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 360us (521us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789135773.879360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:1.0:1789135773.891169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135773.891253:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512525952 00000100:00100000:2.0:1789135773.891262:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512525952 00000100:00100000:2.0:1789135773.891337:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:2.0:1789135773.891347:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512525952:12345-192.168.206.35@tcp:1:lfs.0 00010000:00010000:2.0:1789135773.891389:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.891406:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.891414:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135773.891419:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135773.891423:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.891454:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135773.891468:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 7 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135773.891481:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc156f52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876044545072640:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135773.891562:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3a30ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135773.896883:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc156f52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876044545072640:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135773.896916:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135773.900183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135773.900772:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512526080 00000100:00100000:3.0:1789135773.900782:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512526080 00002000:00100000:3.0:1789135773.900822:0:6685:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8adc3787cf00 x1876044512526080/t0(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:204/0 lens 504/0 e 0 to 0 dl 1789135784 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789135773.900834:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3787cf00 with x1876044512526080 ext(0->12) 00010000:00010000:3.0:1789135773.900842:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 8 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135773.900859:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 8 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135773.900867:0:6685:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc3787cf00 00000100:00100000:3.0:1789135773.900899:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:3.0:1789135773.900908:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512526080:12345-192.168.206.35@tcp:4:lfs.0 00000001:00100000:1.0:1789135774.012460:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000100:00100000:0.0:1789135774.013121:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512526080:12345-192.168.206.35@tcp:4:lfs.0 Request processed in 112208us (112940us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789135774.013137:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00002000:00100000:0.0:1789135774.013149:0:6685:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8adc3787cf00 x1876044512526080/t4294967299(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:204/0 lens 504/448 e 0 to 0 dl 1789135784 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135774.013159:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3787cf00 with x1876044512526080 ext(0->12) 00010000:00010000:0.0:1789135774.013169:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 9 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.013187:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 9 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135774.013195:0:6685:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc3787cf00 00000100:00100000:1.0:1789135774.019899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135774.020679:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512526208 00000100:00100000:3.0:1789135774.020689:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512526208 00010000:00010000:3.0:1789135774.020733:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 9 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135774.020765:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:3.0:1789135774.020775:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2378:x1876044512526208:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135774.020788:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789135774.020805:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789135774.020808:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789135773 00002000:00010000:3.0:1789135774.020811:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789135774 00002000:00010000:3.0:1789135774.020813:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789135773 00010000:00010000:3.0:1789135774.020818:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 9 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.020832:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 9 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.021037:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce42a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d359d expref: 9 pid: 6681 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.021054:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135774.021059:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135774.021158:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.021185:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.021212:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135774.021262:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2378:x1876044512526208:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 487us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135774.021270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00010000:00010000:1.0:1789135774.021283:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.021292:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.021315:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.021323:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.021345:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.021352:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135774.021356:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.021364:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.021378:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.021386:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228cfe45/0x5b09da6ee1ce42ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135774.021438:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512525952:12345-192.168.206.35@tcp:1:lfs.0 Request processed in 130093us (130277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135774.021446:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:1.0:1789135774.026638:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135774.026714:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512526464 00000100:00100000:0.0:1789135774.026723:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512526464 00000100:00100000:0.0:1789135774.026779:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1789135774.026789:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10567:x1876044512526464:12345-192.168.206.35@tcp:35:lfs.0 00000004:00010000:0.0:1789135774.026849:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce42e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35b9 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135774.027175:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789135774.027231:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789135774.027835:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789135774.027891:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.027908:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.027917:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.027952:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.027966:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 23 pid: 5836 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135774.027980:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194efc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1876044545072768:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135774.028092:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3a30f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135774.034669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135774.034775:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194efc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1876044545072768:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135774.034801:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135774.035922:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512526592 00000100:00100000:2.0:1789135774.035946:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512526592 00010000:00010000:2.0:1789135774.035991:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 24 pid: 5836 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135774.036046:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:2.0:1789135774.036057:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+24:2375:x1876044512526592:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135774.036103:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135774.036110:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 24 pid: 5836 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.036124:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 24 pid: 5836 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.036146:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d358f expref: 24 pid: 5836 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.036161:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:2.0:1789135774.036167:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.036176:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.036184:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.036205:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135774.036341:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.036350:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135774.036456:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789135774.036639:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789135774.036762:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194efc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545072896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135774.036823:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135774.036864:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc075e1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135774.037919:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+25:2375:x1876044512526592:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 1844us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.037944:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:2.0:1789135774.038362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545072896 00000100:00100000:2.0:1789135774.038370:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545072896 00000100:00100000:2.0:1789135774.038420:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135774.038428:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876044545072896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789135774.038535:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876044545072896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.038542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135774.038635:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194efc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545072896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789135774.040313:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789135774.040399:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545073024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789135774.040461:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135774.040490:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135774.040577:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545073024 00000100:00100000:2.0:1789135774.040593:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545073024 00000100:00100000:2.0:1789135774.040639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135774.040649:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876044545073024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789135774.040833:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1876044545073024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 185us (371us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789135774.040841:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135774.041317:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545073024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789135774.041376:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789135774.041411:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.041421:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.041427:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.041433:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135774.041437:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.041443:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.041457:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135774.041460:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789135774.041464:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.041469:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce42f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135774.042487:0:5840:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789135774.042711:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789135774.042723:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397614659191ns, next at 398614656933ns, rc = 0 00000001:00080000:1.0:1789135774.042742:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789135774.042786:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135774.042789:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789135774.042797:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce42e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35b9 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135774.045379:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+26:10567:x1876044512526464:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 16115us (16274us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789135774.045395:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000020:00080000:1.0:1789135774.045402:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789135774.052402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135774.052481:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512526720 00000100:00100000:2.0:1789135774.052490:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512526720 00000100:00100000:2.0:1789135774.052546:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1789135774.052556:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+26:10567:x1876044512526720:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135774.052579:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135774.052608:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce42fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35c0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.052663:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce42fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35c0 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.052700:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce42fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35c0 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.052720:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:2.0:1789135774.052723:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135774.052727:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2400, rc 0) 00000100:00100000:2.0:1789135774.052800:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+27:10567:x1876044512526720:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 237us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.052808:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1789135774.060398:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135774.060482:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512526976 00000100:00100000:3.0:1789135774.060492:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512526976 00000100:00100000:3.0:1789135774.060549:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:3.0:1789135774.060559:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+27:10567:x1876044512526976:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1789135774.060780:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+28:10567:x1876044512526976:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 222us (389us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789135774.060788:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:3.0:1789135774.193807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135774.193908:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512527232 00000100:00100000:2.0:1789135774.193917:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512527232 00000100:00100000:2.0:1789135774.193978:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:2.0:1789135774.193987:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+28:10577:x1876044512527232:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135774.194018:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135774.194038:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35c7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135774.194178:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789135774.194271:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4304 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35c7 expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.194285:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:2.0:1789135774.194288:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135774.194292:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35c7 expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.194327:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2800, rc 0) 00000100:00100000:2.0:1789135774.194369:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+29:10577:x1876044512527232:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 384us (572us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789135774.194377:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:1.0:1789135774.202528:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135774.202629:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512527360 00000100:00100000:2.0:1789135774.202644:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512527360 00000100:00100000:2.0:1789135774.202707:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:2.0:1789135774.202717:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+29:10577:x1876044512527360:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:2.0:1789135774.202787:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.202804:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.202815:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.202829:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.202836:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.202843:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.202959:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.202985:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.202992:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135774.203039:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203051:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203058:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203100:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203106:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135774.203110:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203118:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203128:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135774.203131:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135774.203136:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203141:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203161:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203166:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203172:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203177:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135774.203180:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203186:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203194:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1171a100) 00010000:00010000:2.0:1789135774.203196:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135774.203199:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203204:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203220:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203226:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203231:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203243:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135774.203246:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203252:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203259:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:2.0:1789135774.203262:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135774.203264:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.203270:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135774.203340:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+29:10577:x1876044512527360:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 623us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.203347:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:1.0:1789135774.207445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135774.207572:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512527616 00000100:00100000:3.0:1789135774.207581:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512527616 00000100:00100000:3.0:1789135774.207650:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1789135774.207659:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+29:10577:x1876044512527616:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1789135774.207880:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+30:10577:x1876044512527616:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 221us (444us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789135774.207888:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1789135774.220549:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135774.220572:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545073152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135774.220658:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135774.221110:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545073152 00000100:00100000:3.0:1789135774.221117:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545073152 00000100:00100000:3.0:1789135774.221198:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789135774.221209:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545073152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135774.221232:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135774.221300:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545073152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135774.221308:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789135774.221405:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545073152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135774.270800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135774.270950:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512527872 00000100:00100000:1.0:1789135774.270958:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512527872 00000100:00100000:1.0:1789135774.271023:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1789135774.271032:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+30:10580:x1876044512527872:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135774.271055:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135774.271097:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35ce expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271172:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271186:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271197:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271229:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271236:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271243:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271362:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271370:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271378:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135774.271386:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789135774.271467:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271474:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271481:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271487:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135774.271492:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271509:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271521:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135774.271524:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135774.271528:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271534:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce432e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271547:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271554:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271560:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271565:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135774.271568:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271574:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271581:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1953ca00) 00010000:00010000:1.0:1789135774.271584:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135774.271587:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271601:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4335 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271651:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 33 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271664:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 32 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.271672:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:1.0:1789135774.271674:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135774.271676:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480a00, rc 0) 00000100:00100000:1.0:1789135774.271740:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+32:10580:x1876044512527872:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 709us (947us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789135774.271747:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1789135774.275919:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135774.276026:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512528000 00000100:00100000:0.0:1789135774.276034:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512528000 00000100:00100000:0.0:1789135774.276123:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:0.0:1789135774.276133:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+32:10580:x1876044512528000:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1789135774.276206:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276222:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276232:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276255:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276274:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276281:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276287:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135774.276291:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276299:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276327:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:0.0:1789135774.276330:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135774.276334:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.276341:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce434a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135774.276411:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+32:10580:x1876044512528000:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 279us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135774.276419:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1789135774.279661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135774.279794:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512528256 00000100:00100000:0.0:1789135774.279802:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512528256 00000100:00100000:0.0:1789135774.279852:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:0.0:1789135774.279860:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+32:10580:x1876044512528256:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135774.280087:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+33:10580:x1876044512528256:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 226us (433us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789135774.280094:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00010000:00010000:1.0:1789135774.415029:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135774.578165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135774.578261:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512528512 00000100:00100000:1.0:1789135774.578270:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512528512 00000100:00100000:1.0:1789135774.578326:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:1.0:1789135774.578335:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+33:10611:x1876044512528512:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:1.0:1789135774.578358:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135774.578386:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4351 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35d5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.578486:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.578512:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.578524:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135774.578536:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789135774.578668:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4351 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35d5 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.578686:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35d5 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.578694:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:1.0:1789135774.578697:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135774.578701:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481400, rc 0) 00000100:00100000:1.0:1789135774.578769:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+35:10611:x1876044512528512:12345-192.168.206.35@tcp:101:cat.0 Request processed in 434us (611us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789135774.578776:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:1.0:1789135774.585978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135774.586105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135774.586297:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512528896 00000100:00100000:3.0:1789135774.586306:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512528896 00000100:00100000:3.0:1789135774.586590:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1789135774.586602:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+35:2375:x1876044512528896:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135774.586617:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135774.586640:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35d5 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.586659:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:3.0:1789135774.586664:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135774.586716:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+34:2375:x1876044512528896:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 115us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135774.587127:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512528768 00000100:00100000:0.0:1789135774.587133:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512528768 00000100:00100000:0.0:1789135774.587169:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:0.0:1789135774.587176:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+35:10611:x1876044512528768:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:0.0:1789135774.587414:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+36:10611:x1876044512528768:12345-192.168.206.35@tcp:35:cat.0 Request processed in 237us (1444us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789135774.587421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1789135774.597027:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:1.0:1789135774.648768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135774.648913:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512529152 00000100:00100000:2.0:1789135774.648922:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512529152 00000100:00100000:2.0:1789135774.648995:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 158 00000100:00100000:2.0:1789135774.649019:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512529152:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135774.649118:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512529152:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 105us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.649138:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 158 00000100:00080000:3.0:1789135774.653893:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135774.655245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135774.655408:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512529024 00000100:00100000:1.0:1789135774.655417:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512529024 00000100:00100000:1.0:1789135774.655506:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 321 00000100:00100000:1.0:1789135774.655517:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2378:x1876044512529024:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135774.655602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2378:x1876044512529024:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 85us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135774.655625:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 321 00000100:00100000:2.0:1789135774.656986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135774.657095:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512529408 00000100:00100000:1.0:1789135774.657101:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512529408 00000100:00100000:1.0:1789135774.657183:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:1.0:1789135774.657193:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+35:10617:x1876044512529408:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:1.0:1789135774.657215:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135774.657218:0:7852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789135774.657241:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce42be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ab expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.657268:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135774.657274:0:7852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135774.657286:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4366 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35dc expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.657393:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.657407:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 35 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.657416:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.657661:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 35 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135774.657675:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 35 pid: 11758 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135774.657694:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bcb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545073280:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135774.660594:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca180 going to sleep for 11 seconds 00000100:00100000:3.0:1789135774.665272:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135774.665406:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bcb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545073280:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135774.665445:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135774.667151:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512529536 00000100:00100000:0.0:1789135774.667343:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512529536 00010000:00010000:0.0:1789135774.667423:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 36 pid: 11758 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135774.667466:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:0.0:1789135774.667519:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+36:2377:x1876044512529536:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135774.667536:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135774.667543:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 36 pid: 11758 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.667557:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 36 pid: 11758 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.667578:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce433c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ce expref: 36 pid: 11758 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.667594:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:0.0:1789135774.667600:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.667609:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.667616:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.667647:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135774.667713:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+35:2377:x1876044512529536:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 238us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135774.667730:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00010000:00010000:2.0:1789135774.667795:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.667803:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135774.667820:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789135774.667964:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4366 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 36 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.667980:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 35 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.667987:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:2.0:1789135774.667990:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135774.667992:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481000, rc 0) 00000100:00100000:2.0:1789135774.668031:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+35:10617:x1876044512529408:12345-192.168.206.35@tcp:101:dd.0 Request processed in 10839us (11049us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789135774.668038:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:0.0:1789135774.673677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135774.673736:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512529792 00000100:00100000:3.0:1789135774.673744:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512529792 00000100:00100000:3.0:1789135774.673797:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:3.0:1789135774.673830:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+35:10617:x1876044512529792:12345-192.168.206.35@tcp:36:dd.0 00010000:00010000:3.0:1789135774.674118:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.674135:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.674147:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135774.674262:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1789135774.674287:0:11758:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d78b7091 reply state 000000005629ece4 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135774.674295:0:11758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135774.674386:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+38:10617:x1876044512529792:12345-192.168.206.35@tcp:36:dd.0 Request processed in 566us (871us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789135774.674398:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00000020:00080000:3.0:1789135774.674403:0:11758:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789135774.676870:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.676887:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.676895:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.676901:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135774.676906:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.676914:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.676929:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:0.0:1789135774.676932:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135774.676936:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135774.676943:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce437b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135774.969550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135774.969743:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512529920 00000100:00100000:2.0:1789135774.969765:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512529920 00000100:00100000:2.0:1789135774.969835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:2.0:1789135774.969845:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+37:10631:x1876044512529920:12345-192.168.206.35@tcp:101:stat.0 00010000:00010000:2.0:1789135774.969866:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135774.969885:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.969941:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.969955:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.969965:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.969992:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.970009:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.970015:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.970126:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.970138:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 38 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.970157:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.970195:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 38 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.970207:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 38 pid: 7852 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135774.970220:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc04e7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545073408:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135774.970322:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec300 going to sleep for 11 seconds 00000100:00100000:3.0:1789135774.974521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135774.974579:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc04e7c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545073408:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135774.974609:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135774.974636:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512530176 00000100:00100000:0.0:1789135774.974644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512530176 00000100:00100000:0.0:1789135774.974697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:0.0:1789135774.974706:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+39:5617:x1876044512530176:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789135774.975197:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+40:5617:x1876044512530176:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 490us (683us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789135774.975205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:3.0:1789135774.977702:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135774.977927:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512530304 00000100:00100000:2.0:1789135774.977936:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512530304 00010000:00010000:2.0:1789135774.977977:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 40 pid: 7852 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135774.978114:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:2.0:1789135774.978125:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05775c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+40:2375:x1876044512530304:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135774.978190:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135774.978198:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 40 pid: 7852 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.978211:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 40 pid: 7852 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.978251:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce436d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35dc expref: 40 pid: 7852 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.978276:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:2.0:1789135774.978280:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.978290:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.978297:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135774.978330:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135774.978386:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05775c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+39:2375:x1876044512530304:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 264us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.978394:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00010000:00010000:3.0:1789135774.979671:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979683:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135774.979737:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789135774.979741:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135774.979795:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979825:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979834:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979841:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979847:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979853:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135774.979857:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979864:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979876:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:3.0:1789135774.979879:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135774.979883:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979889:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4389 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979908:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979915:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979927:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979931:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135774.979934:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979940:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979948:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1171a100) 00010000:00010000:3.0:1789135774.979951:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135774.979954:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.979959:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.980106:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35e3 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.980121:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35e3 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135774.980128:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:3.0:1789135774.980131:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135774.980133:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3a00, rc 0) 00000100:00100000:3.0:1789135774.980176:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+38:10631:x1876044512529920:12345-192.168.206.35@tcp:101:stat.0 Request processed in 10333us (10634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135774.980192:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:2.0:1789135775.077453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135775.077900:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512530560 00000100:00100000:1.0:1789135775.077910:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512530560 00000100:00100000:1.0:1789135775.078189:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:1.0:1789135775.078201:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+38:10637:x1876044512530560:12345-192.168.206.35@tcp:36:truncate.0 00010000:00010000:1.0:1789135775.078253:0:7852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135775.078278:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35e3 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.078295:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:1.0:1789135775.078300:0:7852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135775.078478:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.078491:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.078501:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135775.078547:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789135775.078571:0:7852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006171b2c3 reply state 000000009ca24b36 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135775.078589:0:7852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135775.078696:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+40:10637:x1876044512530560:12345-192.168.206.35@tcp:36:truncate.0 Request processed in 497us (1252us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789135775.078717:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00000020:00080000:1.0:1789135775.078722:0:7852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1789135775.083379:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789135775.084501:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.084515:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.084522:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.084527:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135775.084531:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.084538:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.084552:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:3.0:1789135775.084555:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135775.084558:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.084564:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce439e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135775.245832:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545073536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135775.245920:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135775.246096:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545073536 00000100:00100000:3.0:1789135775.246104:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545073536 00000100:00100000:3.0:1789135775.246165:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789135775.246173:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545073536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135775.246203:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789135775.246300:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135775.246711:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545073536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 536us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135775.246719:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135775.246866:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545073536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135775.279933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135775.280014:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512530688 00000100:00100000:3.0:1789135775.280021:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512530688 00000100:00100000:3.0:1789135775.280093:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:3.0:1789135775.280103:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+39:10652:x1876044512530688:12345-192.168.206.35@tcp:101:stat.0 00010000:00010000:3.0:1789135775.280123:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135775.280139:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35ea expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280190:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280202:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280212:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280226:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280233:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280239:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280317:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280340:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280347:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135775.280380:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789135775.280384:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135775.280398:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280409:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280416:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280423:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280429:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280435:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135775.280439:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280446:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280456:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:3.0:1789135775.280463:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135775.280469:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280475:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce43ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280488:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280494:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280500:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280505:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135775.280508:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280513:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280520:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc02cc5600) 00010000:00010000:3.0:1789135775.280522:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135775.280524:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280530:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280553:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 41 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280574:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 40 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.280582:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:3.0:1789135775.280584:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135775.280586:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f600, rc 0) 00000100:00100000:3.0:1789135775.280720:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+40:10652:x1876044512530688:12345-192.168.206.35@tcp:101:stat.0 Request processed in 618us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135775.280727:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:0.0:1789135775.399489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135775.399663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512530944 00000100:00100000:3.0:1789135775.399672:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512530944 00000100:00100000:3.0:1789135775.399773:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:3.0:1789135775.399784:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+40:10662:x1876044512530944:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135775.399801:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135775.399818:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135775.399930:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789135775.400042:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f1 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.400056:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:3.0:1789135775.400058:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135775.400092:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f1 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.400118:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f000, rc 0) 00000100:00100000:3.0:1789135775.400174:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+41:10662:x1876044512530944:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 391us (692us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789135775.400181:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:2.0:1789135775.403646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135775.403793:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512531200 00000100:00100000:0.0:1789135775.403802:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512531200 00000100:00100000:0.0:1789135775.403860:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:0.0:1789135775.403878:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+41:10662:x1876044512531200:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135775.404163:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+42:10662:x1876044512531200:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 294us (525us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789135775.404171:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00010000:00010000:0.0:1789135775.436337:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135775.501283:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789135775.541369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135775.541506:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512531456 00000100:00100000:3.0:1789135775.541515:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512531456 00000100:00100000:3.0:1789135775.541629:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:3.0:1789135775.541639:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+42:10668:x1876044512531456:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1789135775.541662:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135775.541682:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35f8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.541775:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.541789:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 43 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.541798:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.541829:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 43 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.541843:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 43 pid: 11758 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135775.541874:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ede00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545073664:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135775.541970:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1a490540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135775.543910:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ede00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545073664:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135775.543945:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135775.544470:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135775.544693:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512531584 00000100:00100000:3.0:1789135775.544699:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512531584 00010000:00010000:3.0:1789135775.544734:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 44 pid: 11758 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135775.545109:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:3.0:1789135775.545120:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+44:2375:x1876044512531584:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135775.545133:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135775.545140:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 44 pid: 11758 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.545152:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 44 pid: 11758 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.545171:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce43ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ea expref: 44 pid: 11758 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.545186:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:3.0:1789135775.545190:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.545198:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.545220:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.545248:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135775.545371:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+43:2375:x1876044512531584:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 252us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135775.545379:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00010000:00010000:0.0:1789135775.545381:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.545388:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135775.545404:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789135775.545547:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce43cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.545562:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.545569:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:0.0:1789135775.545571:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135775.545573:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f000, rc 0) 00000100:00100000:0.0:1789135775.546131:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+43:10668:x1876044512531456:12345-192.168.206.35@tcp:101:bash.0 Request processed in 4492us (4769us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789135775.546139:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:0.0:1789135775.549257:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135775.549379:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512531840 00000100:00100000:1.0:1789135775.549388:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512531840 00000100:00100000:1.0:1789135775.549446:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:1.0:1789135775.549456:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+43:10668:x1876044512531840:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:1.0:1789135775.549678:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.549694:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.549704:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135775.549752:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1789135775.549776:0:11758:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004ae9aef7 reply state 00000000ff9af8c2 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135775.549785:0:11758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135775.549904:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+46:10668:x1876044512531840:12345-192.168.206.35@tcp:36:bash.0 Request processed in 449us (653us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789135775.549911:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00000020:00080000:1.0:1789135775.549916:0:11758:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789135775.556662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:1.0:1789135775.556680:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.556693:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.556718:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.556739:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135775.556744:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.556752:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.556767:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:1.0:1789135775.556771:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135775.556777:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.556784:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce43e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135775.557108:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512531968 00000100:00100000:2.0:1789135775.557117:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512531968 00000100:00100000:2.0:1789135775.557165:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:2.0:1789135775.557175:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+45:10668:x1876044512531968:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1789135775.557202:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135775.557218:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce43eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d35ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.557304:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.557316:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.557325:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.557356:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.557368:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 46 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135775.557382:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545073792:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135775.557661:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135775.560325:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545073792:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135775.560354:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135775.560629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135775.560814:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512532096 00000100:00100000:3.0:1789135775.560821:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512532096 00010000:00010000:3.0:1789135775.560855:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 47 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135775.560892:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:3.0:1789135775.560901:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+47:2375:x1876044512532096:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135775.560913:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135775.560920:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 47 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.560932:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 47 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.560953:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce43d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35f8 expref: 47 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.560967:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:3.0:1789135775.560971:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.561004:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.561012:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135775.561044:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135775.561115:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+46:2375:x1876044512532096:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 215us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135775.561123:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00010000:00010000:0.0:1789135775.561229:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.561236:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135775.561274:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789135775.561279:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135775.561296:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.561325:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce43eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ff expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.561340:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ff expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.561360:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:0.0:1789135775.561363:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135775.561366:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3200, rc 0) 00000100:00100000:0.0:1789135775.561392:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+45:10668:x1876044512531968:12345-192.168.206.35@tcp:101:bash.0 Request processed in 4219us (4737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135775.561399:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:3.0:1789135775.564796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135775.564862:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512532352 00000100:00100000:0.0:1789135775.564872:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512532352 00000100:00100000:0.0:1789135775.564936:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:0.0:1789135775.564946:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+45:10668:x1876044512532352:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:0.0:1789135775.565808:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+46:10668:x1876044512532352:12345-192.168.206.35@tcp:35:bash.0 Request processed in 860us (1014us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789135775.565818:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:1.0:1789135775.653215:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135775.653371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512532608 00000100:00100000:0.0:1789135775.653379:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512532608 00000100:00100000:0.0:1789135775.653431:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:0.0:1789135775.653448:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+46:10678:x1876044512532608:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135775.653470:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135775.653488:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce43f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3606 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135775.653592:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789135775.653687:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce43f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3606 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.653718:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:0.0:1789135775.653721:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135775.653725:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce43f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3606 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135775.653740:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045000, rc 0) 00000100:00100000:0.0:1789135775.653809:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+47:10678:x1876044512532608:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 370us (601us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789135775.653816:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:3.0:1789135775.657144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135775.657516:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512532736 00000100:00100000:2.0:1789135775.657525:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512532736 00000100:00100000:2.0:1789135775.657666:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:2.0:1789135775.657689:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+47:10678:x1876044512532736:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:2.0:1789135775.657770:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657787:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657799:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657812:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657819:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657825:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657914:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657923:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657929:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135775.657965:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.657989:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658012:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658018:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658024:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135775.658028:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658035:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658046:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135775.658049:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135775.658054:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658060:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658095:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658101:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658108:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658112:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135775.658121:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658127:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658135:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1171a300) 00010000:00010000:2.0:1789135775.658138:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135775.658141:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658147:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce440e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658163:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658169:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658176:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658180:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135775.658183:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658189:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658196:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:2.0:1789135775.658198:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135775.658206:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.658212:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135775.658281:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+47:10678:x1876044512532736:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 595us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135775.658289:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:3.0:1789135775.665551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135775.666246:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512532992 00000100:00100000:0.0:1789135775.666265:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512532992 00000100:00100000:0.0:1789135775.666337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:0.0:1789135775.666348:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+47:10678:x1876044512532992:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135775.667158:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+48:10678:x1876044512532992:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 809us (1613us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789135775.667168:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:0.0:1789135775.727033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135775.727220:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512533248 00000100:00100000:2.0:1789135775.727229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512533248 00000100:00100000:2.0:1789135775.727289:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:2.0:1789135775.727299:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+48:10681:x1876044512533248:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135775.727331:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135775.727348:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce441c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d360d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727411:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727424:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727434:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727448:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727455:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727477:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727670:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727679:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.727685:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135775.727694:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789135775.728057:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728094:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728101:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728107:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135775.728111:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728118:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728129:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135775.728132:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135775.728144:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728151:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728164:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728170:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728175:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728181:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135775.728184:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728190:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728197:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1171a300) 00010000:00010000:2.0:1789135775.728199:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135775.728202:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.728208:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce442a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.729529:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce441c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d360d expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.729827:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d360d expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.729838:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:2.0:1789135775.729841:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135775.729844:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3400, rc 0) 00000100:00100000:2.0:1789135775.729968:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10681:x1876044512533248:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 2669us (2945us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789135775.729978:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:3.0:1789135775.741136:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135775.741410:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512533376 00000100:00100000:1.0:1789135775.741419:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512533376 00000100:00100000:1.0:1789135775.741481:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:1.0:1789135775.741492:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10681:x1876044512533376:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1789135775.741556:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741571:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741582:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741619:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741626:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741633:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741639:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135775.741643:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741751:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741765:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:1.0:1789135775.741768:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135775.741773:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.741780:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce443f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135775.741920:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10681:x1876044512533376:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 429us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135775.741928:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:0.0:1789135775.746548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135775.746616:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512533504 00000100:00100000:1.0:1789135775.746625:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512533504 00000100:00100000:1.0:1789135775.746696:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:1.0:1789135775.746717:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+50:2375:x1876044512533504:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135775.746740:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135775.746762:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d360d expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135775.746779:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:1.0:1789135775.746976:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135775.747031:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+49:2375:x1876044512533504:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 314us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135775.747039:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:3.0:1789135775.765800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135775.766698:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512533760 00000100:00100000:0.0:1789135775.766708:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512533760 00000100:00100000:0.0:1789135775.766771:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:0.0:1789135775.766794:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+49:10681:x1876044512533760:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135775.767019:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10681:x1876044512533760:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 238us (1239us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789135775.767041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:3.0:1789135775.984333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135775.987172:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512534016 00000100:00100000:2.0:1789135775.987186:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512534016 00000100:00100000:2.0:1789135775.987269:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:2.0:1789135775.987280:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19455a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10699:x1876044512534016:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:2.0:1789135775.987303:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135775.987320:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4446 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3614 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.987401:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce444d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.987414:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce444d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.987425:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce444d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135775.987436:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789135775.987561:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3614 expref: 53 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.987579:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce444d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3614 expref: 52 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135775.987588:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:2.0:1789135775.987591:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789135775.987594:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2c00, rc 0) 00000100:00100000:2.0:1789135775.987868:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19455a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10699:x1876044512534016:12345-192.168.206.35@tcp:101:cat.0 Request processed in 588us (3541us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789135775.987876:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:2.0:1789135776.032494:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135776.032899:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512534144 00000100:00100000:0.0:1789135776.032909:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512534144 00000100:00100000:0.0:1789135776.032966:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:0.0:1789135776.032975:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10700:x1876044512534144:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135776.033008:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135776.033028:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce445b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d361b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135776.033198:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135776.033213:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135776.033223:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135776.033279:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1789135776.033283:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135776.033304:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135776.033328:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce445b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d361b expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135776.033345:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d361b expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135776.033365:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:0.0:1789135776.033367:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135776.033371:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42044000, rc 0) 00000100:00100000:0.0:1789135776.033764:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10700:x1876044512534144:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 788us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135776.033771:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:3.0:1789135776.040701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135776.040765:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512534528 00000100:00100000:0.0:1789135776.040775:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512534528 00000100:00100000:0.0:1789135776.040905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:0.0:1789135776.040917:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10700:x1876044512534528:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135776.041271:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10700:x1876044512534528:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 356us (578us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789135776.041279:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:3.0:1789135776.044270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135776.044554:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512534656 00000100:00100000:1.0:1789135776.044563:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512534656 00000100:00100000:1.0:1789135776.044638:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:1.0:1789135776.044648:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19457840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10700:x1876044512534656:12345-192.168.206.35@tcp:103:lfs.0 00010000:00010000:1.0:1789135776.044663:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789135776.044685:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce43f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35ff expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.044705:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce444d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3614 expref: 53 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.044716:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce42fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d35c0 expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.044924:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1171a600) 00010000:00010000:1.0:1789135776.044936:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135776.045013:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19457840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+51:10700:x1876044512534656:12345-192.168.206.35@tcp:103:lfs.0 Request processed in 367us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135776.045022:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:2.0:1789135776.048091:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135776.048175:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512534784 00000100:00100000:1.0:1789135776.048183:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512534784 00000100:00100000:1.0:1789135776.048338:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:1.0:1789135776.048349:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+51:10700:x1876044512534784:12345-192.168.206.35@tcp:58:lfs.0 00010000:00010000:1.0:1789135776.048665:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.048680:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.048692:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135776.050346:0:11758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135776.050513:0:11758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789135776.050650:0:11758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789135776.050750:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+51:10700:x1876044512534784:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 2400us (2685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135776.050760:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:0.0:1789135776.070109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.070506:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512534912 00000100:00100000:2.0:1789135776.070515:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512534912 00000100:00100000:2.0:1789135776.070917:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:2.0:1789135776.070931:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+51:10702:x1876044512534912:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135776.070949:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135776.070969:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4470 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3622 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071037:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071051:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071084:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071112:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071119:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071126:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071226:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071235:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071241:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135776.071463:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789135776.071468:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135776.071483:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071495:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071503:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071509:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071526:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071533:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135776.071536:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071544:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071555:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135776.071559:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135776.071563:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071569:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071939:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071946:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071952:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071957:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135776.071960:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071976:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.071984:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1171a300) 00010000:00010000:2.0:1789135776.071987:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135776.072116:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.072124:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce447e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.072308:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4470 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 53 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.072323:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 52 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.072331:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:2.0:1789135776.072334:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135776.072336:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2800, rc 0) 00000100:00100000:2.0:1789135776.072493:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10702:x1876044512534912:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1566us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.072501:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 67 00010000:00010000:1.0:1789135776.461335:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135776.525025:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135776.525041:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135776.525112:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789135776.525124:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135776.525240:0:12074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545073920:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135776.525334:0:12074:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04649540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135776.529197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.529371:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512535040 00000100:00100000:1.0:1789135776.529375:0:12074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41d78f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545073920:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135776.529379:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512535040 00000100:00100000:2.0:1789135776.529440:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:2.0:1789135776.529451:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10713:x1876044512535040:12345-192.168.206.35@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789135776.529553:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10713:x1876044512535040:12345-192.168.206.35@tcp:900:lhsmtool_posix.0 Request processed in 103us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.529562:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:3.0:1789135776.533874:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135776.533999:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512535168 00000100:00100000:0.0:1789135776.534009:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512535168 00000100:00100000:0.0:1789135776.534095:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:0.0:1789135776.534105:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10713:x1876044512535168:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135776.534142:0:5836:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135776.534397:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10713:x1876044512535168:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 292us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135776.534404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:1.0:1789135776.544127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.544266:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512535296 00000100:00100000:2.0:1789135776.544274:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512535296 00000100:00100000:2.0:1789135776.544337:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:2.0:1789135776.544347:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10713:x1876044512535296:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789135776.544413:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544428:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544437:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544450:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544456:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544462:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544486:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544494:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544518:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135776.544552:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789135776.544556:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135776.544571:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544582:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544588:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544595:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544601:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135776.544606:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544613:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544624:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:2.0:1789135776.544627:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135776.544632:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544638:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce448c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544672:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544678:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544684:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544690:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135776.544693:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544699:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544707:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8adc1171a300) 00010000:00010000:2.0:1789135776.544709:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135776.544712:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544718:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4493 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544733:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544739:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544745:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544756:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135776.544758:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544764:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544771:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:2.0:1789135776.544773:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135776.544776:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.544780:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce449a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135776.544855:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10713:x1876044512535296:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 509us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.544871:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:0.0:1789135776.551900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135776.552139:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512535552 00000100:00100000:1.0:1789135776.552149:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512535552 00000100:00100000:1.0:1789135776.552206:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:1.0:1789135776.552216:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10713:x1876044512535552:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135776.552263:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135776.552284:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3629 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552377:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552392:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552403:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135776.552414:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789135776.552501:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552509:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552516:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552523:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135776.552528:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552537:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552549:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135776.552558:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135776.552565:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552572:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552615:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44a1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3629 expref: 54 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552626:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:1.0:1789135776.552628:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135776.552632:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3629 expref: 54 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.552640:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481c00, rc 0) 00000100:00100000:1.0:1789135776.552718:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10713:x1876044512535552:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 502us (826us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789135776.552725:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:0.0:1789135776.559502:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.559643:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512535680 00000100:00100000:3.0:1789135776.559652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512535680 00000100:00100000:3.0:1789135776.559716:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:3.0:1789135776.559725:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10713:x1876044512535680:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135776.559761:0:5837:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135776.559871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10713:x1876044512535680:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 139us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135776.559879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:3.0:1789135776.571449:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.572003:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512535936 00000100:00100000:2.0:1789135776.572013:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512535936 00000100:00100000:2.0:1789135776.572110:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:2.0:1789135776.572120:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10713:x1876044512535936:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135776.572139:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135776.572142:0:11758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789135776.572166:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d361b expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.572189:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135776.572205:0:11758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135776.572219:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce44b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3630 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135776.572696:0:11758:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789135776.572886:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce44bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.572897:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce44bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.572906:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce44bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.572955:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce44b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3630 expref: 55 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.572971:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce44bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3630 expref: 54 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.572979:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171a300) 00010000:00010000:2.0:1789135776.572981:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135776.572984:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3e00, rc 0) 00000100:00100000:2.0:1789135776.574807:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10713:x1876044512535936:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2681us (3359us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789135776.574819:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:0.0:1789135776.585477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.585610:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512536192 00000100:00100000:2.0:1789135776.585619:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512536192 00000100:00100000:2.0:1789135776.585670:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:2.0:1789135776.585680:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10713:x1876044512536192:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789135776.585753:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135776.585776:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce44bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3630 expref: 54 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585791:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171a300) 00010000:00010000:2.0:1789135776.585803:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135776.585823:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585836:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585845:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585859:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585865:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585872:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585941:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585949:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585956:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585968:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135776.585973:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.585981:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586008:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135776.586011:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135776.586016:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586022:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce44cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586031:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586037:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586043:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586048:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135776.586051:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586057:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586107:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x69d6c04e (ffff8adc1171af00) 00010000:00010000:2.0:1789135776.586110:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135776.586113:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.586119:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce44d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x69d6c04e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135776.586195:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10713:x1876044512536192:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 515us (723us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789135776.586202:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:3.0:1789135776.587835:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.589214:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512536320 00000100:00100000:2.0:1789135776.589224:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512536320 00000100:00100000:2.0:1789135776.590378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:2.0:1789135776.590394:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10713:x1876044512536320:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135776.590415:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135776.590437:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce44d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3637 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.590469:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.590482:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.590493:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.590571:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce44d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.590591:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.590600:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:2.0:1789135776.590603:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135776.590606:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2c00, rc 0) 00000100:00100000:2.0:1789135776.590656:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10713:x1876044512536320:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 269us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.590662:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:3.0:1789135776.593901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135776.595965:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512536576 00000100:00100000:1.0:1789135776.595976:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512536576 00000100:00100000:1.0:1789135776.596045:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:1.0:1789135776.596056:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41909e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10713:x1876044512536576:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135776.596139:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.596165:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.596178:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135776.596485:0:7852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1789135776.596495:0:7852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400168431569ns, next at 401168429159ns, rc = 0 00000004:00010000:1.0:1789135776.596575:0:7852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006ae3cd64 reply state 0000000019b37a89 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135776.596586:0:7852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135776.596671:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41909e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10713:x1876044512536576:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 616us (2776us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789135776.596678:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 75 00010000:00010000:1.0:1789135776.598444:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.598458:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.598467:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.598473:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135776.598477:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.598484:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.598498:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:1.0:1789135776.598501:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789135776.598505:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.598526:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce44e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.599751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135776.600130:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512536704 00000100:00100000:1.0:1789135776.600140:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512536704 00000100:00100000:1.0:1789135776.600312:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:1.0:1789135776.600322:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10713:x1876044512536704:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135776.600345:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135776.600363:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d363e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.600416:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.600428:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.600445:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:1.0:1789135776.600448:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135776.600451:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481600, rc 0) 00000100:00100000:1.0:1789135776.600501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10713:x1876044512536704:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 180us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135776.600507:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:3.0:1789135776.602908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135776.602996:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512536832 00000100:00100000:1.0:1789135776.603005:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512536832 00000100:00100000:1.0:1789135776.603048:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1789135776.603056:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1876044512536832:12345-192.168.206.35@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789135776.603117:0:6681:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1789135776.603148:0:6681:0:(genops.c:1385:class_connect()) connect: client 5f7ef768-1508-4eda-9824-c10078b0a61e, cookie 0x5b09da6ee1ce44f5 00002000:00100000:1.0:1789135776.603159:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f7ef768-1508-4eda-9824-c10078b0a61e/ffff8adc03e02800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789135776.603180:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789135776.603416:0:6681:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789135776.603452:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8adc03e00800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135776.603510:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2374:x1876044512536832:12345-192.168.206.35@tcp:8:lhsmtool_posix.0 Request processed in 453us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135776.603518:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1789135776.612686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.614232:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512536960 00000100:00100000:3.0:1789135776.614301:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512536960 00000100:00100000:3.0:1789135776.614420:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:3.0:1789135776.614432:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:0:x1876044512536960:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789135776.617812:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789135776.699747:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000001:00080000:0.0:1789135776.699765:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1789135776.700303:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:0:x1876044512536960:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 85868us (87942us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789135776.700314:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:1.0:1789135776.702871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135776.702952:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512537216 00000100:00100000:0.0:1789135776.702960:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512537216 00000100:00100000:0.0:1789135776.703173:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:0.0:1789135776.703185:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10713:x1876044512537216:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789135776.703509:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+57:10713:x1876044512537216:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 325us (644us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789135776.703517:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:3.0:1789135776.705517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.705606:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512537472 00000100:00100000:2.0:1789135776.705615:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512537472 00000100:00100000:2.0:1789135776.705667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:2.0:1789135776.705676:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+57:10713:x1876044512537472:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135776.705782:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+57:10713:x1876044512537472:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 107us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.705789:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:1.0:1789135776.707702:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.707796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512537600 00000100:00100000:3.0:1789135776.707804:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512537600 00000100:00100000:3.0:1789135776.707846:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:3.0:1789135776.707854:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+57:10713:x1876044512537600:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135776.707872:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135776.707889:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce44fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3645 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.707942:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.707955:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.707966:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135776.708017:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135776.708036:0:5836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.708057:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce44fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3645 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.708105:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3645 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.708114:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:3.0:1789135776.708117:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789135776.708120:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f000, rc 0) 00000100:00100000:3.0:1789135776.708164:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+58:10713:x1876044512537600:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 311us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135776.708170:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:3.0:1789135776.710874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135776.710956:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512537728 00000100:00100000:1.0:1789135776.710964:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512537728 00000100:00100000:1.0:1789135776.711026:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:1.0:1789135776.711035:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512537728:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135776.711052:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135776.711106:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d364c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135776.711132:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40ba0, blocks: 0x1 00010000:00010000:1.0:1789135776.711150:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1789135776.711155:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135776.711164:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.711201:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.711215:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480e00, rc 0) 00000100:00100000:1.0:1789135776.711442:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a356940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512537728:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 407us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135776.711450:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:2.0:1789135776.714393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.714467:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512537984 00000100:00100000:3.0:1789135776.714477:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512537984 00000100:00100000:3.0:1789135776.714532:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:3.0:1789135776.714541:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+58:10713:x1876044512537984:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789135776.714760:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+58:10713:x1876044512537984:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 219us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135776.714768:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:2.0:1789135776.717528:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135776.717659:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512538112 00000100:00100000:1.0:1789135776.717667:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512538112 00000100:00100000:1.0:1789135776.717739:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:1.0:1789135776.717749:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:10713:x1876044512538112:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135776.717766:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135776.717781:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3653 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.717807:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.717816:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135776.717820:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135776.717825:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.717854:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.717874:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 7 pid: 6681 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135776.717887:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545074048:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135776.717968:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135776.720500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.720690:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512538240 00000100:00100000:3.0:1789135776.720698:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512538240 00010000:00010000:3.0:1789135776.720752:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 8 pid: 6681 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.720790:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:3.0:1789135776.720799:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512538240:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135776.720812:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135776.720832:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 8 pid: 6681 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.720845:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 8 pid: 6681 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.720871:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135776.720875:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135776.720883:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.720892:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.720924:0:8444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.720939:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3561c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8444:1876044545074176:192.168.206.35@tcp:105: 00000100:00100000:3.0:1789135776.721010:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1a490d80 going to sleep for 11 seconds 00010000:00010000:2.0:1789135776.721732:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce450a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d364c expref: 8 pid: 6681 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135776.721746:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545074048:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135776.721769:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.721792:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480a00, rc 0) 00000100:00100000:2.0:1789135776.721823:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:10713:x1876044512538112:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 4075us (4304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.721831:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:2.0:1789135776.725960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135776.726459:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512538368 00000100:00100000:0.0:1789135776.726468:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512538368 00002000:00100000:0.0:1789135776.726510:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8adc34e5a940 x1876044512538368/t0(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:207/0 lens 504/0 e 0 to 0 dl 1789135787 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135776.726522:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc34e5a940 with x1876044512538368 ext(0->8) 00002000:00010000:0.0:1789135776.726527:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc34e5a940 00000100:00100000:0.0:1789135776.726551:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:0.0:1789135776.726559:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512538368:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789135776.727231:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512538368:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 Request processed in 671us (1276us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789135776.727239:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00002000:00100000:0.0:1789135776.728836:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8adc34e5a940 x1876044512538368/t4294967302(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:207/0 lens 504/448 e 0 to 0 dl 1789135787 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135776.728848:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc34e5a940 with x1876044512538368 ext(0->8) 00002000:00010000:0.0:1789135776.728854:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc34e5a940 00000100:00100000:3.0:1789135776.729141:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3561c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8444:1876044545074176:192.168.206.35@tcp:105: 00010000:00010000:3.0:1789135776.729172:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135776.729221:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512538240:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 8422us (8728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135776.729231:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:2.0:1789135776.729344:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.729844:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512538496 00000100:00100000:3.0:1789135776.729851:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512538496 00000100:00100000:3.0:1789135776.729896:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:3.0:1789135776.729904:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+58:10713:x1876044512538496:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789135776.785948:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+58:10713:x1876044512538496:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 56036us (56596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.785961:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 80 00000001:00080000:2.0:1789135776.786006:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1789135776.786052:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789135776.786122:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789135776.786139:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adc03fca480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789135776.786143:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc34c2ed00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adc03fcacc0 00000020:00080000:2.0:1789135776.786146:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc34c2e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc34be6400 00000020:00080000:2.0:1789135776.790842:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789135776.790949:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789135776.790967:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34e5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545074304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789135776.791035:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135776.791104:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135776.791110:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34e58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545074432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789135776.791137:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135776.791169:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545074304 00000100:00100000:2.0:1789135776.791175:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545074304 00000100:00100000:2.0:1789135776.791218:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545074432 00000100:00100000:2.0:1789135776.791221:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545074432 00000100:00100000:2.0:1789135776.793540:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789135776.793557:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545074304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789135776.793705:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789135776.793708:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789135777 00002000:00010000:2.0:1789135776.793710:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789135776.793713:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789135776 -> 1789135777 00002000:00010000:2.0:1789135776.793715:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789135776.793776:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044545074304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (2741us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789135776.793783:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789135776.793802:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789135776.793808:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044545074432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789135776.793822:0:6680:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789135776.793841:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa40b9d, atime: 0x6aa40b9e, ctime: 0x6aa40b9d, blocks: 0x1 00010000:00010000:2.0:1789135776.793848:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.793862:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789135776.793866:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135776.793871:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.793886:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.793906:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.793914:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.793930:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789135776.794779:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044545074432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 970us (3639us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789135776.794787:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789135776.794931:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135776.794972:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000004:00080000:2.0:1789135776.795041:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc34e58b40/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789135776.795052:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34e58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545074432:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789135776.795083:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc34e5b840/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789135776.795087:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34e5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545074304:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789135776.795102:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135776.795108:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.795118:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135776.795122:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.795143:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.795158:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.795166:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce4518 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.795183:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135776.795184:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135776.795185:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135776.795334:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512538624 00000100:00100000:1.0:1789135776.795340:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512538624 00000100:00100000:1.0:1789135776.795380:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:1.0:1789135776.795387:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512538624:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789135776.880116:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1789135776.880139:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789135776.880430:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512538624:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 85037us (85453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135776.880441:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:2.0:1789135776.898020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.898552:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512538880 00000100:00100000:3.0:1789135776.898562:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512538880 00000100:00100000:3.0:1789135776.898636:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:3.0:1789135776.898645:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:10713:x1876044512538880:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135776.898694:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135776.898720:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3645 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.898750:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:3.0:1789135776.898756:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135776.898784:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.898796:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.898805:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135776.899025:0:5837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004ed65199 reply state 000000002fe81df7 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.899041:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135776.899167:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+14:10713:x1876044512538880:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 523us (1157us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789135776.899175:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 81 00010000:00010000:2.0:1789135776.901918:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.901936:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.901944:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.901950:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135776.901954:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.901961:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.902003:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:2.0:1789135776.902006:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135776.902012:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.902018:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce451f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135776.905493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.905582:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512539008 00000100:00100000:3.0:1789135776.905599:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512539008 00000100:00100000:3.0:1789135776.905656:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:3.0:1789135776.905666:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512539008:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789135776.905906:0:6765:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789135776.905910:0:6765:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789135777 -> 1789135775 00002000:00010000:3.0:1789135776.905912:0:6765:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789135774 00002000:00010000:3.0:1789135776.905914:0:6765:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789135777 -> 1789135775 00002000:00010000:3.0:1789135776.905917:0:6765:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789135776.906304:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512539008:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 638us (820us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789135776.906313:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:1.0:1789135776.920517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.920720:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512539264 00000100:00100000:3.0:1789135776.920729:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512539264 00000100:00100000:3.0:1789135776.920783:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:3.0:1789135776.920794:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+13:10713:x1876044512539264:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789135776.920870:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.920889:0:11758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.920914:0:11758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.920951:0:11758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.920965:0:11758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 13 pid: 5838 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.920981:0:11758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545074560:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135776.924445:0:11758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1a490540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135776.925817:0:11758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545074560:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135776.925841:0:11758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135776.929237:0:12384:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135776.929246:0:12384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135776.929282:0:12384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789135776.929288:0:12384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135776.933233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.934277:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512539392 00000100:00100000:3.0:1789135776.934288:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512539392 00010000:00010000:3.0:1789135776.934334:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 14 pid: 5838 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.934371:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:3.0:1789135776.934380:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+14:2378:x1876044512539392:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135776.934395:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135776.934402:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 14 pid: 5838 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934432:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 14 pid: 5838 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934455:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce44e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3637 expref: 14 pid: 5838 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934471:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:3.0:1789135776.934476:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934486:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934494:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934521:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135776.934589:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:2378:x1876044512539392:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 209us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135776.934605:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00010000:00010000:3.0:1789135776.934635:0:11758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934643:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934668:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934686:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934693:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934699:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135776.934703:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934711:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934719:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:3.0:1789135776.934900:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789135776.934906:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.934913:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4526 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.934955:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+12:10713:x1876044512539264:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 Request processed in 14163us (14447us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789135776.934964:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:2.0:1789135776.937385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.937420:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512539520 00000100:00100000:2.0:1789135776.937429:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512539520 00000100:00100000:2.0:1789135776.937490:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:2.0:1789135776.937500:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512539520:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789135776.937545:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.937564:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.937573:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135776.937578:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135776.937583:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.937628:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.937642:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 7 pid: 6682 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135776.937657:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34e58780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876044545074688:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135776.937740:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc392f1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135776.940870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135776.943156:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34e58780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876044545074688:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135776.943184:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.943789:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512539648 00000100:00100000:3.0:1789135776.943798:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512539648 00010000:00010000:3.0:1789135776.943836:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 8 pid: 6682 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.943884:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1789135776.943902:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05776c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512539648:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135776.943916:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135776.943936:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 8 pid: 6682 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.943950:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 8 pid: 6682 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.943971:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce4511 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3653 expref: 8 pid: 6682 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.943998:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135776.944003:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135776.944008:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.944018:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.944114:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135776.944173:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05776c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512539648:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 271us (3312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135776.944183:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00010000:00010000:2.0:1789135776.948396:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.948415:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.948448:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.948456:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.948476:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.948484:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135776.948488:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.948497:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.948514:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135776.948522:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064cf029a/0x5b09da6ee1ce452d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135776.948620:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512539520:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 11118us (11242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.948630:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:3.0:1789135776.962943:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.962973:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512539904 00000100:00100000:3.0:1789135776.962982:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512539904 00000100:00100000:3.0:1789135776.963039:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:3.0:1789135776.963056:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+12:10713:x1876044512539904:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789135776.963139:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.963154:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.963166:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.963495:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.963506:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.963515:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.963545:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.963559:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 13 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.963872:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545074816:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135776.963957:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1a4903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135776.977904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135776.978335:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545074816:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135776.978361:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.978398:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512540032 00000100:00100000:3.0:1789135776.978403:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512540032 00010000:00010000:3.0:1789135776.978436:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 14 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135776.978486:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:3.0:1789135776.978496:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+14:2377:x1876044512540032:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135776.978509:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135776.978517:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 14 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.978528:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 14 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.978546:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce44ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d363e expref: 14 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.978558:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:3.0:1789135776.978563:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.978584:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.978591:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.978611:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135776.978660:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+13:2377:x1876044512540032:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 165us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135776.978668:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00010000:00010000:3.0:1789135776.978695:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135776.978702:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135776.979316:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789135776.979457:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789135776.979498:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789135776.979605:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545074944:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789135776.979656:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135776.979693:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135776.982704:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545074944 00000100:00100000:2.0:1789135776.982719:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545074944 00000100:00100000:2.0:1789135776.982782:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789135776.982792:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7852:x1876044545074944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789135776.982904:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7852:x1876044545074944:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135776.982920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135776.985191:0:7852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789135776.985203:0:7852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc34e5b840, transno 4294967303 00000100:00100000:3.0:1789135776.985223:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545074944:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789135776.985700:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789135776.985795:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545075072:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789135776.985851:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135776.985874:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1a4903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135776.991554:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545075072 00000100:00100000:2.0:1789135776.991573:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545075072 00000100:00100000:2.0:1789135776.991627:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135776.991637:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7852:x1876044545075072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789135776.991906:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7852:x1876044545075072:12345-0@lo:1000:mdt00_003.0 Request processed in 270us (6053us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789135776.991914:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135776.992209:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545075072:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789135776.992249:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992259:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992266:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992289:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135776.992294:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992302:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992317:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:1.0:1789135776.992320:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135776.992325:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992330:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce453b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992364:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992371:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992376:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992380:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135776.992383:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992389:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992408:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135776.992410:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135776.992413:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992420:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4469 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992441:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992453:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 16 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992461:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992494:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 16 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135776.992507:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 16 pid: 7852 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135776.992519:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545075200:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135776.992600:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1a4903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135777.001489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135777.004633:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512540160 00000100:00100000:0.0:1789135777.004653:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512540160 00010000:00010000:0.0:1789135777.004713:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 17 pid: 7852 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135777.004753:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:0.0:1789135777.004762:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+17:2375:x1876044512540160:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135777.004776:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135777.004783:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 17 pid: 7852 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135777.004797:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 17 pid: 7852 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135777.004816:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:0.0:1789135777.004822:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135777.004839:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135777.004846:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135777.004865:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135777.004912:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+17:2375:x1876044512540160:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 151us (3433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135777.004919:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00010000:00010000:3.0:1789135777.006200:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3622 expref: 16 pid: 7852 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135777.006221:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545075200:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135777.006239:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006417:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006423:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006435:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006440:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006448:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006453:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135777.006457:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006464:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006476:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:3.0:1789135777.006479:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135777.006483:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006489:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4542 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006509:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006520:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006526:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006531:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135777.006534:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006539:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006547:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:3.0:1789135777.006549:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135777.006552:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135777.006557:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4534 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135777.007347:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+15:10713:x1876044512539904:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 44286us (44405us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789135777.007358:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 83 00000020:00080000:3.0:1789135777.007365:0:7852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00080000:3.0:1789135777.008684:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135777.009522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135777.009645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512540416 00000100:00100000:1.0:1789135777.009655:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512540416 00000100:00100000:1.0:1789135777.009737:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:1.0:1789135777.009748:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+15:10713:x1876044512540416:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789135777.010431:0:5839:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789135777.010872:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789135777.010917:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.010934:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.010944:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.010952:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.010958:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.010964:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.010995:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789135777.011101:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+17:10713:x1876044512540416:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 1353us (1582us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789135777.011110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000020:00080000:1.0:1789135777.011115:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789135777.011152:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135777.011158:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.011165:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135777.011169:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.011184:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.011196:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:1.0:1789135777.011199:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789135777.011204:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.011210:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4549 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135777.011224:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135777.011226:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135777.011228:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135777.015320:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135777.015326:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135777.015356:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789135777.015363:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789135777.485205:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135778.508207:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135778.682276:0:12435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135778.682285:0:12435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135778.682321:0:12435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789135778.682327:0:12435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135778.786846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135778.787018:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512540672 00000100:00100000:1.0:1789135778.787027:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512540672 00000100:00100000:1.0:1789135778.787098:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:1.0:1789135778.787109:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+17:10731:x1876044512540672:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135778.787132:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135778.787150:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d365a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.787373:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4557 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.787387:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4557 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.787398:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4557 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135778.787418:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1789135778.787578:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d365a expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.787594:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4557 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d365a expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.787602:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135778.787605:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135778.787608:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480a00, rc 0) 00000100:00100000:1.0:1789135778.787667:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10731:x1876044512540672:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 560us (830us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789135778.787675:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:3.0:1789135778.796554:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135778.796674:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512540800 00000100:00100000:0.0:1789135778.796684:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512540800 00000100:00100000:0.0:1789135778.796747:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:0.0:1789135778.796757:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10731:x1876044512540800:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:0.0:1789135778.796831:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.796850:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.796860:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.796887:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.796895:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.796901:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797250:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797259:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797266:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135778.797316:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797329:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797335:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797341:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797347:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135778.797351:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797366:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797376:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:0.0:1789135778.797379:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135778.797384:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797391:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797403:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797408:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797414:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797418:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135778.797421:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797426:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797432:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc062d3200) 00010000:00010000:0.0:1789135778.797435:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135778.797438:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797453:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce456c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797469:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797475:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797481:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797485:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135778.797488:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797494:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797501:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135778.797503:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135778.797505:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.797510:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135778.797588:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10731:x1876044512540800:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 831us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135778.797597:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:1.0:1789135778.831887:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545075456:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.831952:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135778.832010:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545075968:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832037:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135778.832084:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789135778.832090:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545075328:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832117:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135778.832149:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545075840:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832172:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135778.832199:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545075584:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135778.832257:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135778.832263:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545075712:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832299:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135778.832334:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545075456 00000100:00100000:1.0:1789135778.832340:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545075456 00000100:00100000:1.0:1789135778.832385:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545075840 00000100:00100000:1.0:1789135778.832388:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545075840 00000100:00100000:1.0:1789135778.832416:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545075584 00000100:00100000:1.0:1789135778.832419:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545075584 00000100:00100000:1.0:1789135778.832434:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789135778.832441:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545075456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832486:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545075456:12345-0@lo:400:kworker.0 Request processed in 45us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135778.832493:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789135778.832517:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789135778.832523:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545075840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832547:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876044545075840:12345-0@lo:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135778.832552:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789135778.832564:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789135778.832569:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545075584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832597:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545075584:12345-0@lo:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135778.832603:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789135778.832620:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545075968 00000100:00100000:1.0:1789135778.832623:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545075968 00000100:00100000:1.0:1789135778.832646:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545075712 00000100:00100000:1.0:1789135778.832649:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545075712 00000100:00100000:1.0:1789135778.832677:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789135778.832683:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1876044545075968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832710:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1876044545075968:12345-0@lo:400:kworker.0 Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135778.832715:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789135778.832726:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789135778.832731:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34007c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044545075712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832753:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34007c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044545075712:12345-0@lo:400:kworker.0 Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135778.832758:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789135778.832800:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545075712:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832809:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545075584:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832834:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876044545075840:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832842:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545075456:0@lo:400:kworker.0 00000100:00100000:1.0:1789135778.832851:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545075968:0@lo:400:kworker.0 00000100:00100000:2.0:1789135778.836275:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545075328 00000100:00100000:2.0:1789135778.836286:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545075328 00000100:00100000:2.0:1789135778.836337:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789135778.836345:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545075328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135778.836420:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545075328:12345-0@lo:400:kworker.0 Request processed in 76us (4302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135778.836428:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789135778.836478:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545075328:0@lo:400:kworker.0 00000100:00080000:3.0:1789135778.836597:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135778.836611:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135778.836614:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135778.840113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135778.840160:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512541056 00000100:00100000:0.0:1789135778.840169:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512541056 00000100:00100000:0.0:1789135778.840216:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:0.0:1789135778.840227:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10734:x1876044512541056:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135778.840246:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135778.840265:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce457a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3661 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.840326:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.840340:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.840350:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.840363:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.840369:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.840376:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.846385:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.846402:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.846421:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135778.846434:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789135778.846536:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.846544:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.846550:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.846993:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135778.847000:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847007:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847021:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:0.0:1789135778.847024:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135778.847028:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847034:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4581 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847251:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847257:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847271:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847277:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135778.847280:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847286:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847295:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc062d3c00) 00010000:00010000:0.0:1789135778.847298:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135778.847301:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847306:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847352:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce457a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 22 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847364:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 21 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.847371:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:0.0:1789135778.847373:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135778.847375:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045000, rc 0) 00000100:00100000:0.0:1789135778.847435:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+21:10734:x1876044512541056:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 7209us (7330us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789135778.847453:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:0.0:1789135778.851948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135778.854896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512541184 00000100:00100000:1.0:1789135778.854909:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512541184 00000100:00100000:1.0:1789135778.854970:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:1.0:1789135778.854989:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+21:10734:x1876044512541184:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1789135778.855079:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855096:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855123:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855148:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855155:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855162:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855168:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135778.855172:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855179:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855189:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:1.0:1789135778.855192:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135778.855197:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.855203:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce459d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135778.855274:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+21:10734:x1876044512541184:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 296us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135778.855282:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:0.0:1789135778.861588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135778.861647:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512541440 00000100:00100000:1.0:1789135778.861664:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512541440 00000100:00100000:1.0:1789135778.861717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:1.0:1789135778.861727:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+21:10734:x1876044512541440:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1789135778.861935:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+22:10734:x1876044512541440:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 208us (354us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789135778.861943:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:1.0:1789135778.898160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135778.898292:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512541696 00000100:00100000:0.0:1789135778.898300:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512541696 00000100:00100000:0.0:1789135778.898351:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:0.0:1789135778.898360:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+22:10253:x1876044512541696:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1789135778.898381:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135778.898399:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce45a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3668 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.898484:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.898498:0:11758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 23 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.898506:0:11758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.898536:0:11758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 23 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.898550:0:11758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 23 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135778.898563:0:11758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057f8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545076096:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135778.898676:0:11758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135778.902018:0:11758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057f8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545076096:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135778.902046:0:11758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135778.906281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135778.906400:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512541824 00000100:00100000:0.0:1789135778.906409:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512541824 00010000:00010000:0.0:1789135778.906447:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 24 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135778.906487:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:0.0:1789135778.906495:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34005a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+24:2376:x1876044512541824:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135778.906509:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135778.906516:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 24 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.906527:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 24 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.906548:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce458f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3661 expref: 24 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.906563:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:0.0:1789135778.906568:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.906576:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.906897:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.906931:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135778.907003:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34005a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+23:2376:x1876044512541824:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 508us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135778.907011:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00010000:00010000:1.0:1789135778.907848:0:11758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.907860:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135778.907878:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789135778.908025:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce45a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 24 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.908042:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 23 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.908051:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:1.0:1789135778.908054:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135778.908057:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045e00, rc 0) 00000100:00100000:1.0:1789135778.908143:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+23:10253:x1876044512541696:12345-192.168.206.35@tcp:101:bash.0 Request processed in 9784us (9994us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789135778.908151:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:1.0:1789135778.917687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135778.917769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512542080 00000100:00100000:0.0:1789135778.917779:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512542080 00000100:00100000:0.0:1789135778.917834:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:0.0:1789135778.917845:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+23:10253:x1876044512542080:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:0.0:1789135778.918128:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.918144:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.918154:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135778.918204:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1789135778.918228:0:5836:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ef3e1f44 reply state 00000000c8ff6f1f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135778.918237:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789135778.918280:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1789135778.918374:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+27:10253:x1876044512542080:12345-192.168.206.35@tcp:36:bash.0 Request processed in 530us (694us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789135778.918381:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 89 00000020:00080000:0.0:1789135778.918385:0:5836:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789135778.919801:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.919816:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.919823:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.919828:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135778.919832:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.919839:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.919854:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:1.0:1789135778.919857:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135778.919861:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135778.919867:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce45b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135778.923910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135778.924216:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512542208 00000100:00100000:0.0:1789135778.924226:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512542208 00000100:00100000:0.0:1789135778.924294:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 90 00000100:00100000:0.0:1789135778.924304:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34006940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+26:10253:x1876044512542208:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1789135778.924339:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135778.924360:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce45c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d366f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.924413:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce45c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d366f expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.924427:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce45c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d366f expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135778.924446:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:0.0:1789135778.924449:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135778.924453:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42044000, rc 0) 00000100:00100000:0.0:1789135778.924513:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34006940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+27:10253:x1876044512542208:12345-192.168.206.35@tcp:101:bash.0 Request processed in 210us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135778.924520:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 90 00000100:00100000:0.0:1789135778.938543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135778.938824:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512542336 00000100:00100000:2.0:1789135778.938834:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512542336 00000100:00100000:2.0:1789135778.938907:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:2.0:1789135778.938917:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:10253:x1876044512542336:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1789135778.938935:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135778.938955:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3676 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135778.939008:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa40b9f, atime: 0x6aa40b9e, ctime: 0x6aa40b9f, blocks: 0xb 00010000:00010000:2.0:1789135778.939028:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1789135778.939033:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135778.939041:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135778.939093:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135778.939107:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2800, rc 0) 00000100:00100000:2.0:1789135778.939159:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:10253:x1876044512542336:12345-192.168.206.35@tcp:101:bash.0 Request processed in 243us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135778.939167:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00080000:3.0:1789135778.939336:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135778.941645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135778.941817:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512542464 00000100:00100000:0.0:1789135778.941825:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512542464 00002000:00010000:0.0:1789135778.941860:0:6685:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789135778.941865:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc41bfcf00 with x1876044512542464 ext(0->18446744073709551615) 00002000:00010000:0.0:1789135778.941875:0:6685:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc41bfcf00. 00000100:00100000:0.0:1789135778.941908:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:0.0:1789135778.941917:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512542464:12345-192.168.206.35@tcp:10:bash.0 00002000:00010000:0.0:1789135778.942227:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789135778.942242:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789135775 -> 1789135779 00002000:00010000:0.0:1789135778.942245:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789135774 -> 1789135774 00002000:00010000:0.0:1789135778.942258:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789135775 -> 1789135779 00002000:00010000:0.0:1789135778.942260:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789135778.942310:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512542464:12345-192.168.206.35@tcp:10:bash.0 Request processed in 393us (672us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789135778.942318:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00002000:00010000:0.0:1789135778.942321:0:6685:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789135778.942323:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc41bfcf00 with x1876044512542464 ext(0->18446744073709551615) 00002000:00010000:0.0:1789135778.942328:0:6685:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc41bfcf00. 00000100:00100000:0.0:1789135779.019201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.019298:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512542592 00000100:00100000:1.0:1789135779.019308:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512542592 00000100:00100000:1.0:1789135779.019390:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:1.0:1789135779.019413:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+27:10748:x1876044512542592:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:1.0:1789135779.019482:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.019498:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.019510:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.019526:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.019533:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.019540:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789135779.019857:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135779.019997:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020007:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020015:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135779.020056:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020110:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020123:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020129:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020136:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.020545:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020556:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020614:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135779.020618:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.020623:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020629:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020641:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020647:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020654:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020659:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.020670:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020677:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020685:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1953c800) 00010000:00010000:1.0:1789135779.020688:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.020690:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020695:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020710:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020715:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020839:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020847:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.020850:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020857:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020865:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:1.0:1789135779.020867:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.020877:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.020883:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135779.021011:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+27:10748:x1876044512542592:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 1597us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.021021:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:2.0:1789135779.077646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.077922:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512542848 00000100:00100000:1.0:1789135779.077931:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512542848 00000100:00100000:1.0:1789135779.078209:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:1.0:1789135779.078221:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+27:10751:x1876044512542848:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135779.078240:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135779.078261:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d367d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078326:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078339:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078350:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078364:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078370:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078394:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078947:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce45f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078959:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce45f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.078967:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce45f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135779.078985:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789135779.079112:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079119:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079125:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079131:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.079134:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079221:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079233:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135779.079237:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.079249:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079255:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce45ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079268:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079275:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079281:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079286:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.079289:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079295:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079302:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1953c800) 00010000:00010000:1.0:1789135779.079304:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.079317:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079323:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce45f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079369:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce45e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d367d expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079396:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce45f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d367d expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.079404:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:1.0:1789135779.079406:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789135779.079408:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481e00, rc 0) 00000100:00100000:1.0:1789135779.079689:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+29:10751:x1876044512542848:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1469us (2051us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789135779.079704:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:3.0:1789135779.084174:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.084309:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512542976 00000100:00100000:2.0:1789135779.084319:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512542976 00000100:00100000:2.0:1789135779.084377:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:2.0:1789135779.084388:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+29:10751:x1876044512542976:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:2.0:1789135779.084581:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.084599:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 29 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.084610:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.084657:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 29 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.084670:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 29 pid: 11758 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135779.084684:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34e58000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545076224:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135779.084870:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc075e1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135779.086832:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34e58000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545076224:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135779.086857:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.088236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.088330:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512543232 00000100:00100000:1.0:1789135779.088338:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512543232 00000100:00100000:1.0:1789135779.088390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:1.0:1789135779.088400:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+30:5617:x1876044512543232:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789135779.089609:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+31:5617:x1876044512543232:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 1205us (1372us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789135779.089620:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:0.0:1789135779.092905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.092989:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512543360 00000100:00100000:2.0:1789135779.092998:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512543360 00010000:00010000:2.0:1789135779.093036:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 31 pid: 11758 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135779.093100:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:2.0:1789135779.093109:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+31:2375:x1876044512543360:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135779.093124:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135779.093131:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 31 pid: 11758 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.093145:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 31 pid: 11758 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.093187:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce45ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3668 expref: 31 pid: 11758 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.093204:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:2.0:1789135779.093208:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.093218:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.093226:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.093408:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135779.093466:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+30:2375:x1876044512543360:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 357us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.093475:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00010000:00010000:0.0:1789135779.095170:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.095183:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.095214:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.095221:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.095228:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.095296:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135779.095300:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.095326:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.095340:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:0.0:1789135779.095343:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135779.095347:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.095352:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4606 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.095462:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+29:10751:x1876044512542976:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 11073us (11294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.095472:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:0.0:1789135779.097620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.097708:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512543616 00000100:00100000:3.0:1789135779.097717:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512543616 00000100:00100000:3.0:1789135779.097926:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:3.0:1789135779.097938:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+29:10751:x1876044512543616:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1789135779.098451:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+30:10751:x1876044512543616:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 513us (895us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789135779.098459:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:2.0:1789135779.141329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.141454:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512543872 00000100:00100000:1.0:1789135779.141464:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512543872 00000100:00100000:1.0:1789135779.141521:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:1.0:1789135779.141531:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+30:10762:x1876044512543872:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:1.0:1789135779.141555:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135779.141574:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce460d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3684 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.141641:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.141664:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.141675:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.141691:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.141699:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.141705:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142687:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142699:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142708:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135779.142718:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789135779.142906:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142914:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142920:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142933:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.142937:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142944:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142956:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135779.142959:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.142963:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142970:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4614 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142991:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.142997:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.143003:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.143008:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.143011:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.143017:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.143034:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1953c800) 00010000:00010000:1.0:1789135779.143037:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.143040:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.143046:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce461b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.143126:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce460d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3684 expref: 33 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.143139:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3684 expref: 32 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.143147:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:1.0:1789135779.143149:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135779.143151:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481c00, rc 0) 00000100:00100000:1.0:1789135779.143216:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+32:10762:x1876044512543872:12345-192.168.206.35@tcp:101:cat.0 Request processed in 1687us (1897us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789135779.143224:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:0.0:1789135779.148505:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.148578:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512544128 00000100:00100000:1.0:1789135779.148586:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512544128 00000100:00100000:1.0:1789135779.148738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:1.0:1789135779.148748:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+32:10762:x1876044512544128:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:1.0:1789135779.149578:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+33:10762:x1876044512544128:12345-192.168.206.35@tcp:35:cat.0 Request processed in 830us (1081us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789135779.149587:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:0.0:1789135779.163113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.164945:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512544384 00000100:00100000:1.0:1789135779.164958:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512544384 00000100:00100000:1.0:1789135779.165032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 95 00000100:00100000:1.0:1789135779.165043:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+33:10763:x1876044512544384:12345-192.168.206.35@tcp:36:rm.0 00010000:00010000:1.0:1789135779.165125:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789135779.165149:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3684 expref: 33 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165169:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce45f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d367d expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165181:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce45c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d366f expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165193:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc062d3200) 00010000:00010000:1.0:1789135779.165202:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135779.165219:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165231:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165240:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165252:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165259:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165276:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165681:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.165691:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.166359:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135779.167606:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1789135779.167618:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402739554417ns, next at 403739551938ns, rc = 0 00010000:00010000:1.0:1789135779.167685:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.167698:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.167707:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.167715:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.167721:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.167727:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168283:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135779.168312:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168319:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168325:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168331:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.168335:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168402:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168417:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:1.0:1789135779.168420:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789135779.168425:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168433:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce463e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168454:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168461:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168468:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168482:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.168486:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168493:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168502:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135779.168504:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.168508:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.168514:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4630 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135779.168524:0:5837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008598bd78 reply state 0000000001bfe421 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135779.168534:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135779.168623:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+32:10763:x1876044512544384:12345-192.168.206.35@tcp:36:rm.0 Request processed in 3579us (5559us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789135779.168632:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 95 00010000:00010000:0.0:1789135779.168739:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135779.168746:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.168753:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135779.168756:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.168763:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.168946:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:0.0:1789135779.168955:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789135779.168959:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.168965:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4645 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.168991:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135779.168993:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135779.168995:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135779.173441:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.173459:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.173468:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.173475:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.173479:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.173487:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.173503:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1953c800) 00010000:00010000:3.0:1789135779.173524:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135779.173530:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.173536:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4637 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.203279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.203346:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512544640 00000100:00100000:2.0:1789135779.203355:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512544640 00000100:00100000:2.0:1789135779.203410:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 96 00000100:00100000:2.0:1789135779.203420:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35031e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+31:10769:x1876044512544640:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1789135779.203444:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135779.203464:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce464c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d368b expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.203594:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.203614:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.203624:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.203638:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.203646:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.203652:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135779.204232:0:7852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789135779.204381:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204391:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204399:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204429:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204436:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204443:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204456:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135779.204460:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204467:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204479:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135779.204482:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135779.204487:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204493:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4653 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135779.204505:0:7852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008f3c88e4 reply state 00000000852407bb transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135779.204514:0:7852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789135779.204541:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce464c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 34 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204555:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 33 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.204562:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:2.0:1789135779.204564:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135779.204566:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3c00, rc 0) 00000100:00100000:2.0:1789135779.204641:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35031e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+34:10769:x1876044512544640:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1222us (1370us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789135779.204655:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 96 00010000:00010000:1.0:1789135779.206824:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.206839:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.206847:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.206864:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.206869:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.206876:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.206889:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc1171af00) 00010000:00010000:1.0:1789135779.206892:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.206896:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.206902:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce465a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.210275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.210305:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512544768 00000100:00100000:1.0:1789135779.210315:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512544768 00000100:00100000:1.0:1789135779.210398:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:1.0:1789135779.210410:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc350330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512544768:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135779.210428:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135779.210447:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3692 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135779.210474:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135779.210496:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1789135779.210501:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135779.210511:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.210549:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.210562:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480e00, rc 0) 00000100:00100000:1.0:1789135779.210617:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc350330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512544768:12345-192.168.206.35@tcp:101:bash.0 Request processed in 210us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.210625:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00080000:0.0:1789135779.210700:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135779.221947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.222897:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512544896 00000100:00100000:3.0:1789135779.222907:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512544896 00000100:00100000:3.0:1789135779.222968:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:3.0:1789135779.222989:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:10769:x1876044512544896:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1789135779.223007:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135779.223023:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3699 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.223052:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.223095:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135779.223100:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135779.223105:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.223139:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.223152:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 9 pid: 6680 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.223184:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bff0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876044545076352:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135779.223307:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc013773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135779.225700:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bff0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876044545076352:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135779.225732:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.225750:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f000, rc 0) 00000100:00100000:2.0:1789135779.225813:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:10769:x1876044512544896:12345-192.168.206.35@tcp:101:bash.0 Request processed in 2826us (3874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.225822:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:0.0:1789135779.238438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.238636:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512545024 00000100:00100000:3.0:1789135779.238644:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512545024 00010000:00010000:3.0:1789135779.238684:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 9 pid: 6680 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.238769:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:3.0:1789135779.238779:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc350312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2375:x1876044512545024:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135779.238802:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135779.238823:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 9 pid: 6680 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.238836:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 9 pid: 6680 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.238859:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005933c60c/0x5b09da6ee1ce466f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3692 expref: 9 pid: 6680 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.238876:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135779.238895:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135779.238903:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.238933:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.238967:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.238991:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876044545076480:192.168.206.35@tcp:105: 00000100:00100000:3.0:1789135779.239108:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc013773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135779.241763:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfde00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876044545076480:192.168.206.35@tcp:105: 00010000:00010000:1.0:1789135779.241797:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135779.241855:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc350312c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512545024:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 3077us (3425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.241866:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:1.0:1789135779.245057:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.245157:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512545280 00000100:00100000:3.0:1789135779.245165:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512545280 00000100:00100000:3.0:1789135779.245212:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:3.0:1789135779.245221:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34004f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+33:10769:x1876044512545280:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:3.0:1789135779.245513:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34004f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+34:10769:x1876044512545280:12345-192.168.206.35@tcp:35:bash.0 Request processed in 292us (465us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789135779.245521:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:2.0:1789135779.340497:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135779.340520:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545076608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135779.340588:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135779.340730:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545076608 00000100:00100000:0.0:1789135779.340738:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545076608 00000100:00100000:0.0:1789135779.340789:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789135779.340799:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044545076608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135779.340833:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135779.340884:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044545076608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.340892:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789135779.341102:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545076608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135779.372557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135779.372701:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512545408 00000100:00100000:0.0:1789135779.372710:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512545408 00000100:00100000:0.0:1789135779.372806:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 97 00000100:00100000:0.0:1789135779.372816:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34007840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+34:10785:x1876044512545408:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135779.372840:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135779.372858:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce467d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36a0 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.372928:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.372954:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.372965:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135779.373025:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1789135779.373029:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135779.373049:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.373106:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce467d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36a0 expref: 36 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.373122:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36a0 expref: 35 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.373130:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:0.0:1789135779.373132:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135779.373136:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045400, rc 0) 00000100:00100000:0.0:1789135779.373182:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34007840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+35:10785:x1876044512545408:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 367us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.373196:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 97 00000100:00100000:3.0:1789135779.376158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.376191:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512545664 00000100:00100000:3.0:1789135779.376198:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512545664 00000100:00100000:3.0:1789135779.376241:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:3.0:1789135779.376252:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+35:10785:x1876044512545664:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135779.376273:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135779.376482:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce468b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36a7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.377254:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4692 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.377271:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.377282:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135779.377293:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789135779.377409:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce468b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36a7 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.377426:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36a7 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.377433:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:3.0:1789135779.377436:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135779.377439:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e200, rc 0) 00000100:00100000:3.0:1789135779.377490:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+37:10785:x1876044512545664:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1240us (1341us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789135779.377498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:1.0:1789135779.382409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.382772:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512545920 00000100:00100000:3.0:1789135779.382789:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512545920 00000100:00100000:3.0:1789135779.382859:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:3.0:1789135779.382870:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34004b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+37:10785:x1876044512545920:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135779.382892:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789135779.383449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.383499:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512546048 00000100:00100000:2.0:1789135779.383505:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512546048 00000100:00100000:2.0:1789135779.383553:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:2.0:1789135779.383563:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34005e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+38:2376:x1876044512546048:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135779.383578:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135779.383601:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4692 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36a7 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.383620:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:2.0:1789135779.383626:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135779.383683:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34005e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+37:2376:x1876044512546048:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 122us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.383692:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00010000:00010000:3.0:1789135779.384307:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36ae expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.384387:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce46a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.384399:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce46a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.384408:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce46a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135779.384418:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789135779.384518:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ae expref: 39 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.384532:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce46a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ae expref: 38 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.384539:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:3.0:1789135779.384541:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789135779.384544:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31ee00, rc 0) 00000100:00100000:3.0:1789135779.384711:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34004b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+38:10785:x1876044512545920:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1843us (2310us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789135779.384718:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:3.0:1789135779.393328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135779.393425:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512546176 00000100:00100000:0.0:1789135779.393434:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512546176 00000100:00100000:0.0:1789135779.393502:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:0.0:1789135779.393512:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2377:x1876044512546176:12345-192.168.206.35@tcp:1:lfs.0 00010000:00010000:0.0:1789135779.393571:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.393590:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.393599:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135779.393603:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135779.393608:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.393641:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.393655:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 8 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.393670:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35030780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876044545076736:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135779.393748:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc057729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135779.404615:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.404664:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512546304 00000100:00100000:2.0:1789135779.404672:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512546304 00002000:00100000:2.0:1789135779.404721:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8adc34e583c0 x1876044512546304/t0(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:210/0 lens 504/0 e 0 to 0 dl 1789135790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135779.404732:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc34e583c0 with x1876044512546304 ext(0->8) 00010000:00010000:2.0:1789135779.404742:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 9 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.404770:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 9 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135779.404778:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc34e583c0 00000100:00100000:2.0:1789135779.405143:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:2.0:1789135779.405155:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512546304:12345-192.168.206.35@tcp:4:lfs.0 00000100:00100000:2.0:1789135779.406109:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+11:2376:x1876044512546304:12345-192.168.206.35@tcp:4:lfs.0 Request processed in 950us (1496us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789135779.406120:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00002000:00100000:2.0:1789135779.406130:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8adc34e583c0 x1876044512546304/t4294967302(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:210/0 lens 504/448 e 0 to 0 dl 1789135790 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135779.406139:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc34e583c0 with x1876044512546304 ext(0->8) 00010000:00010000:2.0:1789135779.406147:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 11 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.406172:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 11 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135779.406179:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc34e583c0 00000100:00100000:2.0:1789135779.406848:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35030780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876044545076736:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135779.406875:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135779.409747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.410022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512546432 00000100:00100000:3.0:1789135779.410031:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512546432 00010000:00010000:3.0:1789135779.410095:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 11 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.410150:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:3.0:1789135779.410160:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05774850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+11:2378:x1876044512546432:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135779.410175:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789135779.410194:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789135779.410196:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789135779 00002000:00010000:3.0:1789135779.410199:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789135779 00002000:00010000:3.0:1789135779.410201:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789135779 00010000:00010000:3.0:1789135779.410208:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 11 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.410223:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 11 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.410258:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4676 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3699 expref: 11 pid: 6682 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.410274:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135779.410278:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135779.410284:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.410294:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.410322:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135779.410374:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05774850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2378:x1876044512546432:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 214us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.410381:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 55 00010000:00010000:2.0:1789135779.413550:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.413578:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.413613:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.413621:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.413629:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.413651:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42044000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135779.413655:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.413664:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.413679:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.413686:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c5a596d/0x5b09da6ee1ce46b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135779.413776:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2377:x1876044512546176:12345-192.168.206.35@tcp:1:lfs.0 Request processed in 20262us (20453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.413791:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:2.0:1789135779.423706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.423924:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512546688 00000100:00100000:1.0:1789135779.423934:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512546688 00000100:00100000:1.0:1789135779.423996:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:1.0:1789135779.424005:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+38:10785:x1876044512546688:12345-192.168.206.35@tcp:35:lfs.0 00000004:00010000:1.0:1789135779.424082:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce46a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ae expref: 38 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135779.424322:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789135779.424384:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789135779.424752:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789135779.424810:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.424838:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 42 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.424848:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.424879:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 42 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.424894:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 42 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135779.424908:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340070c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1876044545076864:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135779.424998:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1a490780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135779.431493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.431508:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340070c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1876044545076864:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135779.431539:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135779.431643:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512546816 00000100:00100000:1.0:1789135779.431650:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512546816 00010000:00010000:1.0:1789135779.431684:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 43 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135779.431718:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:1.0:1789135779.431738:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35032d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+43:2375:x1876044512546816:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135779.431763:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135779.431771:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 43 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.431803:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 43 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.431833:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d368b expref: 43 pid: 7852 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.431848:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:1.0:1789135779.431853:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.431862:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.431869:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.431884:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135779.431948:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35032d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+42:2375:x1876044512546816:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 212us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.431956:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00010000:00010000:3.0:1789135779.432430:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.432436:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135779.432540:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789135779.432716:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1789135779.433019:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545076992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789135779.433093:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135779.433120:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc156c7840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135779.433155:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545076992 00000100:00100000:0.0:1789135779.433162:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545076992 00000100:00100000:0.0:1789135779.433203:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135779.433212:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1876044545076992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135779.433297:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1876044545076992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.433304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135779.433345:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fb840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545076992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789135779.433733:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789135779.433802:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545077120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789135779.433997:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135779.434024:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0553f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135779.435131:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545077120 00000100:00100000:0.0:1789135779.435140:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545077120 00000100:00100000:0.0:1789135779.435174:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789135779.435181:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34004780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1876044545077120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135779.435425:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34004780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5840:x1876044545077120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 244us (1427us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789135779.435433:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135779.435601:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340052c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545077120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789135779.435692:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789135779.435742:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.435753:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.435768:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.435774:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.435785:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.435794:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.435809:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:1.0:1789135779.435813:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789135779.435818:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.436738:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce46bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135779.437588:0:5840:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789135779.437685:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789135779.437696:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403009632460ns, next at 404009630450ns, rc = 0 00000001:00080000:1.0:1789135779.437704:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789135779.437752:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:1.0:1789135779.437768:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789135779.437796:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce46a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ae expref: 46 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135779.439830:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+45:10785:x1876044512546688:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 15813us (16118us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789135779.439843:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000020:00080000:1.0:1789135779.439848:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789135779.444968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.445053:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512546944 00000100:00100000:1.0:1789135779.445357:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512546944 00000100:00100000:1.0:1789135779.445416:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 100 00000100:00100000:1.0:1789135779.445425:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35031680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+45:10785:x1876044512546944:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135779.445450:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135779.445476:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce46c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36b5 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.445540:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce46c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36b5 expref: 46 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.445555:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce46c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36b5 expref: 46 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.445584:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135779.445587:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135779.445591:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480e00, rc 0) 00000100:00100000:1.0:1789135779.445655:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35031680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+46:10785:x1876044512546944:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 230us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.445662:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 100 00000100:00100000:1.0:1789135779.448140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.448257:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512547200 00000100:00100000:3.0:1789135779.448266:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512547200 00000100:00100000:3.0:1789135779.448315:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:3.0:1789135779.448324:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34004f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+46:10785:x1876044512547200:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1789135779.448568:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34004f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+47:10785:x1876044512547200:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 238us (429us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789135779.448575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000001:00080000:1.0:1789135779.448955:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1789135779.448969:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1789135779.500123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.500354:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512547328 00000100:00100000:3.0:1789135779.500362:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512547328 00000100:00100000:3.0:1789135779.500413:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 101 00000100:00100000:3.0:1789135779.500431:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35032580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+47:10795:x1876044512547328:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:3.0:1789135779.500545:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.500564:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.500574:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.500588:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.500594:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.500600:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.500802:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.500811:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.500818:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135779.501033:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501051:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501085:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501089:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501093:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.501097:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501101:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501110:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:3.0:1789135779.501112:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135779.501116:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501120:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501130:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501133:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501136:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501140:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.501145:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501149:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501153:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135779.501155:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135779.501156:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501159:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501169:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501172:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501175:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501178:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.501180:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501184:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501190:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:3.0:1789135779.501193:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135779.501200:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.501206:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.501289:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35032580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+47:10795:x1876044512547328:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 852us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.501298:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 101 00010000:00010000:1.0:1789135779.532482:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135779.536934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.537044:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512547584 00000100:00100000:3.0:1789135779.537055:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512547584 00000100:00100000:3.0:1789135779.537164:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 102 00000100:00100000:3.0:1789135779.537175:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34006d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+47:10798:x1876044512547584:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135779.537195:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135779.537215:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36bc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537279:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537304:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537315:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537329:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537336:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537366:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537501:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537509:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537517:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135779.537526:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789135779.537613:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537621:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537628:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537633:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.537637:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537644:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537656:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:3.0:1789135779.537660:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135779.537671:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537743:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce46e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537758:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537765:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537770:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537776:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.537779:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537785:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537793:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135779.537795:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135779.537799:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537805:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce46ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537843:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce46df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537931:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.537938:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:3.0:1789135779.537941:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135779.537943:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e800, rc 0) 00000100:00100000:3.0:1789135779.538016:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34006d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+49:10798:x1876044512547584:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 842us (1091us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789135779.538023:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 102 00000100:00100000:1.0:1789135779.541967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.542129:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512547712 00000100:00100000:3.0:1789135779.542138:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512547712 00000100:00100000:3.0:1789135779.542253:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:3.0:1789135779.542264:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34005680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+49:10798:x1876044512547712:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:3.0:1789135779.542326:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542343:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542354:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542380:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542387:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542412:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542419:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.542423:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542431:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542443:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:3.0:1789135779.542446:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135779.542452:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.542459:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4702 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.542534:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34005680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+49:10798:x1876044512547712:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 271us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.542542:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:0.0:1789135779.548921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.549032:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512547968 00000100:00100000:3.0:1789135779.549041:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512547968 00000100:00100000:3.0:1789135779.549189:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:3.0:1789135779.549201:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+49:10798:x1876044512547968:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1789135779.549455:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10798:x1876044512547968:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 257us (540us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789135779.549464:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:1.0:1789135779.594994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.595173:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512548224 00000100:00100000:3.0:1789135779.595181:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512548224 00000100:00100000:3.0:1789135779.595278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 104 00000100:00100000:3.0:1789135779.595288:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34006580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10808:x1876044512548224:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1789135779.595313:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135779.595316:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789135779.595341:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36a0 expref: 50 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.595359:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:3.0:1789135779.595363:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135779.595375:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4709 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.595462:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.595476:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.595485:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.595516:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.595528:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 50 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.595668:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc340d2940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545077248:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135779.596300:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc156c7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135779.598569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.599105:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512548352 00000100:00100000:2.0:1789135779.599114:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512548352 00010000:00010000:2.0:1789135779.599154:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 51 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135779.599192:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:2.0:1789135779.599202:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+51:2375:x1876044512548352:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135779.599216:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135779.599236:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 51 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.599249:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 51 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.599272:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:2.0:1789135779.599282:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.599293:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.599301:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135779.599319:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135779.599371:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+51:2375:x1876044512548352:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 170us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.599379:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00010000:00010000:0.0:1789135779.599992:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce46f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36bc expref: 50 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.600011:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc340d2940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545077248:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135779.600030:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.600039:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.600044:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135779.600094:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789135779.600227:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4709 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.600250:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.600259:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:0.0:1789135779.600261:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135779.600264:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f400, rc 0) 00000100:00100000:0.0:1789135779.600302:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34006580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10808:x1876044512548224:12345-192.168.206.35@tcp:101:bash.0 Request processed in 5016us (5332us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789135779.600310:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 104 00000100:00100000:3.0:1789135779.606059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135779.606266:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512548608 00000100:00100000:0.0:1789135779.606276:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512548608 00000100:00100000:0.0:1789135779.606337:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 105 00000100:00100000:0.0:1789135779.606347:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+50:10808:x1876044512548608:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:0.0:1789135779.606598:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.606615:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.606626:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135779.606675:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1789135779.606699:0:5836:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e8a4a6c4 reply state 0000000062f32693 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.606707:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135779.606812:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10808:x1876044512548608:12345-192.168.206.35@tcp:36:bash.0 Request processed in 466us (762us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789135779.606820:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 105 00000020:00080000:0.0:1789135779.606825:0:5836:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789135779.610478:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.610493:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.610501:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.610507:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42044000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135779.610512:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.610519:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.610535:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135779.610538:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135779.610543:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.610550:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce471e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.613459:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.613631:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512548736 00000100:00100000:1.0:1789135779.613641:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512548736 00000100:00100000:1.0:1789135779.613713:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 106 00000100:00100000:1.0:1789135779.613722:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10808:x1876044512548736:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135779.613812:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135779.613832:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36ca expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.614046:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.614287:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.614299:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.614689:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.614704:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 53 pid: 5838 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.614717:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc350321c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545077376:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135779.614963:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135779.616810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135779.616835:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc350321c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545077376:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135779.616857:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135779.616957:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512548864 00000100:00100000:1.0:1789135779.616964:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512548864 00010000:00010000:1.0:1789135779.617009:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 54 pid: 5838 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135779.617045:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:1.0:1789135779.617054:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+54:2375:x1876044512548864:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135779.617102:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135779.617109:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 54 pid: 5838 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.617120:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 54 pid: 5838 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.617159:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4710 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36c3 expref: 54 pid: 5838 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.617171:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135779.617176:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.617185:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.617193:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135779.617212:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135779.617301:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+53:2375:x1876044512548864:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 247us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.617309:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00010000:00010000:0.0:1789135779.617320:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.617327:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135779.617366:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789135779.617370:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135779.617389:0:5837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.617415:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4725 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.617440:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.617448:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:0.0:1789135779.617450:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135779.617453:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481600, rc 0) 00000100:00100000:0.0:1789135779.617486:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10808:x1876044512548736:12345-192.168.206.35@tcp:101:bash.0 Request processed in 3765us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.617493:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 106 00000100:00100000:2.0:1789135779.620129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135779.620332:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512549120 00000100:00100000:1.0:1789135779.620341:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512549120 00000100:00100000:2.0:1789135779.620458:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:2.0:1789135779.620467:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+52:10808:x1876044512549120:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:2.0:1789135779.620704:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10808:x1876044512549120:12345-192.168.206.35@tcp:35:bash.0 Request processed in 237us (584us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789135779.620712:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:2.0:1789135779.662344:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135779.662470:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512549248 00000100:00100000:0.0:1789135779.662481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512549248 00000100:00100000:0.0:1789135779.662552:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:0.0:1789135779.662562:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+53:10814:x1876044512549248:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135779.662586:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135779.662606:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.662666:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce473a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.662680:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce473a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.662691:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce473a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135779.662749:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1789135779.662758:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135779.662783:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce473a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.662808:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36d1 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.662895:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce473a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36d1 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.662905:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:0.0:1789135779.662908:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135779.662911:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045a00, rc 0) 00000100:00100000:0.0:1789135779.662966:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10814:x1876044512549248:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 405us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.662982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:0.0:1789135779.667371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.667437:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512549376 00000100:00100000:3.0:1789135779.667447:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512549376 00000100:00100000:3.0:1789135779.667506:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 108 00000100:00100000:3.0:1789135779.667517:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc350321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10814:x1876044512549376:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135779.667536:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135779.667565:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4741 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36d8 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667624:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667651:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667661:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667677:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667685:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667709:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667802:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667810:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667818:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135779.667848:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789135779.667852:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135779.667868:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667880:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667888:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667895:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667903:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667909:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.667913:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667928:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667940:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:3.0:1789135779.667943:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135779.667948:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667955:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667970:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667988:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.667994:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.668000:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135779.668003:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.668009:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.668017:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135779.668019:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135779.668022:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.668038:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce474f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.668092:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4741 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36d8 expref: 56 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.668105:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36d8 expref: 55 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.668112:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:3.0:1789135779.668114:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135779.668117:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e600, rc 0) 00000100:00100000:3.0:1789135779.669924:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc350321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10814:x1876044512549376:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 2399us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.669935:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 108 00000100:00100000:2.0:1789135779.677287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.677328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.677614:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512549760 00000100:00100000:3.0:1789135779.677624:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512549760 00000100:00100000:3.0:1789135779.677699:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:3.0:1789135779.677709:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+55:2376:x1876044512549760:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135779.677724:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135779.677747:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36d8 expref: 55 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.677749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512549632 00000100:00100000:0.0:1789135779.677756:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512549632 00010000:00010000:3.0:1789135779.677771:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:3.0:1789135779.677777:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135779.677795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 109 00000100:00100000:0.0:1789135779.677806:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10814:x1876044512549632:12345-192.168.206.35@tcp:101:lfs.0 00000100:00100000:3.0:1789135779.677829:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+55:2376:x1876044512549760:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 120us (498us total) trans 0 rc 0/0 00010000:00010000:0.0:1789135779.677835:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789135779.677851:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00010000:00010000:0.0:1789135779.677852:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce475d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36df expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.679401:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.679424:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.679442:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.679476:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.679492:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 55 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135779.679507:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35033c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545077504:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135779.679594:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135779.684886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135779.684994:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35033c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545077504:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135779.685023:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.685458:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512549888 00000100:00100000:3.0:1789135779.685467:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512549888 00010000:00010000:3.0:1789135779.685510:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 56 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135779.685548:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:3.0:1789135779.685571:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+56:2375:x1876044512549888:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135779.685587:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135779.685595:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 56 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.685608:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 56 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.685768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce472c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ca expref: 56 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.685783:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:3.0:1789135779.685789:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.685797:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.685805:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.685851:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135779.685910:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+55:2375:x1876044512549888:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 342us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.685918:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00010000:00010000:0.0:1789135779.685986:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.685994:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135779.686010:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789135779.686165:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce475d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.686192:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.686211:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:0.0:1789135779.686214:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135779.686217:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42044000, rc 0) 00000100:00100000:0.0:1789135779.686252:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10814:x1876044512549632:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 8449us (8974us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789135779.686259:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 109 00000100:00100000:2.0:1789135779.689471:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.689730:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512550144 00000100:00100000:3.0:1789135779.689739:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512550144 00000100:00100000:3.0:1789135779.689799:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1789135779.689809:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10814:x1876044512550144:12345-192.168.206.35@tcp:103:lfs.0 00010000:00010000:3.0:1789135779.689825:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135779.689851:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce46c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36b5 expref: 55 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.689867:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:3.0:1789135779.689872:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135779.689921:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10814:x1876044512550144:12345-192.168.206.35@tcp:103:lfs.0 Request processed in 113us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.689928:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:1.0:1789135779.692223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135779.693220:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512550272 00000100:00100000:0.0:1789135779.693240:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512550272 00000100:00100000:0.0:1789135779.693309:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 110 00000100:00100000:0.0:1789135779.693319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10814:x1876044512550272:12345-192.168.206.35@tcp:58:lfs.0 00010000:00010000:0.0:1789135779.693432:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.693449:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135779.693460:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789135779.693875:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789135779.694059:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10814:x1876044512550272:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 740us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.694092:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 110 00000100:00100000:0.0:1789135779.697448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.699941:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512550400 00000100:00100000:3.0:1789135779.699955:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512550400 00000100:00100000:3.0:1789135779.700102:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:3.0:1789135779.700113:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35033c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+54:10814:x1876044512550400:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135779.700135:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135779.700155:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36e6 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.700220:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.700251:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36e6 expref: 55 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.700269:0:7852:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.700283:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36e6 expref: 55 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.700304:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:3.0:1789135779.700307:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135779.700311:0:7852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36e6 expref: 55 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135779.700319:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e600, rc 0) 00000100:00100000:3.0:1789135779.700429:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35033c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10814:x1876044512550400:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 318us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.700437:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:2.0:1789135779.763418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.763538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.763577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.763612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135779.763637:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512550912 00000100:00100000:2.0:1789135779.763646:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512550912 00000100:00100000:2.0:1789135779.763687:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512550784 00000100:00100000:2.0:1789135779.763690:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512550784 00000100:00100000:2.0:1789135779.763710:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:2.0:1789135779.763719:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512550912:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135779.763798:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512550912:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.763807:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:2.0:1789135779.763822:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:2.0:1789135779.763830:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512550784:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135779.763868:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512550784:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 39us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.763875:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:2.0:1789135779.763933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135779.764055:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512550528 00000100:00100000:3.0:1789135779.764060:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512550528 00000100:00100000:3.0:1789135779.764122:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 323 00000100:00100000:3.0:1789135779.764130:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512550528:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135779.764159:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512550528:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.764165:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 323 00000100:00100000:0.0:1789135779.765003:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512550656 00000100:00100000:0.0:1789135779.765011:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512550656 00000100:00100000:0.0:1789135779.765162:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512551040 00000100:00100000:0.0:1789135779.765177:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512551040 00000100:00100000:3.0:1789135779.765257:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 162 00000100:00100000:3.0:1789135779.765273:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+55:2376:x1876044512550656:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135779.765319:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+55:2376:x1876044512550656:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 48us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.765327:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 162 00000100:00100000:1.0:1789135779.765389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 163 00000100:00100000:1.0:1789135779.765397:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512551040:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135779.765424:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512551040:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 29us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.765431:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 163 00000100:00080000:2.0:1789135779.765477:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789135780.108366:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135780.108375:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135780.108410:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789135780.108427:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135780.108560:0:12074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc350303c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545077632:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135780.108665:0:12074:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc057729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.114237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.114241:0:12074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc350303c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545077632:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135780.114326:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512551168 00000100:00100000:3.0:1789135780.114334:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512551168 00000100:00100000:3.0:1789135780.114448:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 112 00000100:00100000:3.0:1789135780.114457:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10815:x1876044512551168:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135780.114484:0:7852:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135780.114562:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10815:x1876044512551168:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 105us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.114569:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 112 00000100:00100000:3.0:1789135780.120674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135780.126048:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512551296 00000100:00100000:2.0:1789135780.126087:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512551296 00000100:00100000:2.0:1789135780.126477:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:2.0:1789135780.126489:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10815:x1876044512551296:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789135780.126574:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126590:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126602:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126657:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126664:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126670:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126687:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126695:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126701:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135780.126731:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789135780.126734:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135780.126744:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126770:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126776:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126783:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126788:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135780.126791:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126798:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126808:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:2.0:1789135780.126811:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135780.126817:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126823:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4780 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126835:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126841:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126846:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126857:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135780.126860:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126866:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126874:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8adc1171a900) 00010000:00010000:2.0:1789135780.126877:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135780.126879:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126885:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4787 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126901:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126907:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.126924:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.127047:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135780.127051:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.127058:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.127110:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:2.0:1789135780.127112:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135780.127116:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.127121:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce478e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.127199:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10815:x1876044512551296:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 711us (6532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.127206:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 113 00000100:00100000:3.0:1789135780.130385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135780.130516:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512551552 00000100:00100000:2.0:1789135780.130525:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512551552 00000100:00100000:2.0:1789135780.130581:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:2.0:1789135780.130591:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+55:10815:x1876044512551552:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135780.130609:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135780.130627:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4795 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36ed expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130716:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130731:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130742:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135780.130753:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789135780.130851:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130858:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130864:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130870:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135780.130874:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130882:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130893:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:2.0:1789135780.130896:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789135780.130901:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130907:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce479c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130962:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4795 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ed expref: 57 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.130984:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:2.0:1789135780.130986:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135780.130990:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4795 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36ed expref: 57 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.131013:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2000, rc 0) 00000100:00100000:2.0:1789135780.131095:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10815:x1876044512551552:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 505us (717us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789135780.131103:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 114 00000100:00100000:1.0:1789135780.140180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.140460:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512551680 00000100:00100000:3.0:1789135780.140471:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512551680 00000100:00100000:0.0:1789135780.140612:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:0.0:1789135780.140626:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10815:x1876044512551680:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135780.140665:0:5836:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135780.140887:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10815:x1876044512551680:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 264us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.141331:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 115 00000100:00100000:3.0:1789135780.150822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135780.150967:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512551936 00000100:00100000:2.0:1789135780.150991:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512551936 00000100:00100000:2.0:1789135780.151048:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:2.0:1789135780.151058:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10815:x1876044512551936:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135780.151099:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135780.151102:0:11758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789135780.151129:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce473a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36d1 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.151150:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:2.0:1789135780.151155:0:11758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135780.151169:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce47aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36f4 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135780.152727:0:11758:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789135780.153028:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce47b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.153044:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce47b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.153055:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce47b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.153151:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce47aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36f4 expref: 58 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.153168:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce47b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36f4 expref: 57 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.153175:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135780.153178:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135780.153181:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3600, rc 0) 00000100:00100000:2.0:1789135780.153256:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+57:10815:x1876044512551936:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2200us (2444us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789135780.153266:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 116 00000100:00100000:3.0:1789135780.160956:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135780.161109:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512552192 00000100:00100000:1.0:1789135780.161132:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512552192 00000100:00100000:1.0:1789135780.161192:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:1.0:1789135780.161202:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+57:10815:x1876044512552192:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135780.161258:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135780.161283:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce47b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36f4 expref: 57 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161301:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:1.0:1789135780.161313:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135780.161334:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161346:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161356:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161384:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161392:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161398:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161465:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161473:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161486:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161492:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135780.161496:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161503:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161511:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135780.161514:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135780.161518:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161523:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce47bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161531:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161537:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161542:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161547:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135780.161561:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161577:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161586:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2b40bb88 (ffff8adc1953c800) 00010000:00010000:1.0:1789135780.161588:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135780.161591:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.161596:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce47c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2b40bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.161677:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10815:x1876044512552192:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 475us (731us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135780.161685:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 117 00000100:00100000:1.0:1789135780.164252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.164985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512552320 00000100:00100000:0.0:1789135780.164995:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512552320 00000100:00100000:0.0:1789135780.165198:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:0.0:1789135780.165210:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+56:10815:x1876044512552320:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135780.165235:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135780.165258:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce47cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d36fb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.165294:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.165308:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.165342:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.165452:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce47cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.165470:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.165478:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135780.165481:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789135780.165484:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045c00, rc 0) 00000100:00100000:0.0:1789135780.165545:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+57:10815:x1876044512552320:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 337us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.168945:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 118 00000100:00100000:2.0:1789135780.169339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.169585:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512552576 00000100:00100000:3.0:1789135780.169596:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512552576 00000100:00100000:3.0:1789135780.169646:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 119 00000100:00100000:3.0:1789135780.169657:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+57:10815:x1876044512552576:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135780.169735:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.169753:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.169782:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135780.170036:0:11758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1789135780.170045:0:11758:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403741981501ns, next at 404741979330ns, rc = 0 00000004:00010000:3.0:1789135780.170164:0:11758:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fd1e29da reply state 0000000044fb6551 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.170175:0:11758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135780.170260:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+59:10815:x1876044512552576:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 605us (922us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789135780.170268:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 119 00010000:00010000:3.0:1789135780.172569:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.172585:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.172593:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.172599:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135780.172604:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.172611:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.172626:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:3.0:1789135780.172629:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789135780.172648:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.172655:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce47db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.173871:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.174122:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512552704 00000100:00100000:3.0:1789135780.174133:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512552704 00000100:00100000:3.0:1789135780.174190:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:3.0:1789135780.174200:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+58:10815:x1876044512552704:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135780.174222:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135780.174246:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3702 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.174302:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 59 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.174316:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 59 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.174333:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:3.0:1789135780.174337:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135780.174340:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f400, rc 0) 00000100:00100000:3.0:1789135780.174405:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+59:10815:x1876044512552704:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 207us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.174413:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:1.0:1789135780.179413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135780.181379:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512552832 00000100:00100000:2.0:1789135780.181392:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512552832 00000100:00100000:2.0:1789135780.181479:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:2.0:1789135780.181492:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34005a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512552832:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789135780.181797:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34005a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512552832:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 307us (2391us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789135780.181805:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00080000:0.0:1789135780.183119:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135780.186459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.187885:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512553088 00000100:00100000:3.0:1789135780.187895:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512553088 00000100:00100000:3.0:1789135780.187948:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:3.0:1789135780.187966:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+59:10815:x1876044512553088:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789135780.188225:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+60:10815:x1876044512553088:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 258us (1773us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789135780.188233:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:1.0:1789135780.190814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.190998:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512553344 00000100:00100000:0.0:1789135780.191007:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512553344 00000100:00100000:0.0:1789135780.191101:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:0.0:1789135780.191111:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34005e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+60:10815:x1876044512553344:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789135780.191217:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34005e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+60:10815:x1876044512553344:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 108us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.191230:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 121 00000100:00100000:1.0:1789135780.193489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.193935:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512553472 00000100:00100000:0.0:1789135780.193943:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512553472 00000100:00100000:0.0:1789135780.194052:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:0.0:1789135780.194115:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+60:10815:x1876044512553472:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135780.194135:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135780.194157:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce47e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3709 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.194222:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce47f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.194409:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce47f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.194422:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce47f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135780.194458:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135780.194473:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce47f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.194497:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce47e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3709 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.194514:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce47f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3709 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.194523:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135780.194526:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789135780.194529:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045a00, rc 0) 00000100:00100000:0.0:1789135780.194711:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+61:10815:x1876044512553472:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 602us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.194729:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:2.0:1789135780.201234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.201290:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512553600 00000100:00100000:0.0:1789135780.201299:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512553600 00000100:00100000:0.0:1789135780.201393:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1789135780.201403:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2377:x1876044512553600:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135780.201419:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135780.201438:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3710 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135780.201464:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40ba4, blocks: 0x1 00010000:00010000:0.0:1789135780.201480:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789135780.201485:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135780.201494:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201513:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201526:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045400, rc 0) 00000100:00100000:0.0:1789135780.201654:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2377:x1876044512553600:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 251us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.201662:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:1.0:1789135780.203787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.203920:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512553856 00000100:00100000:0.0:1789135780.203928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512553856 00000100:00100000:0.0:1789135780.204026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:0.0:1789135780.204036:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+61:10815:x1876044512553856:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789135780.204164:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+61:10815:x1876044512553856:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 129us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.204171:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 123 00000100:00100000:3.0:1789135780.205929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135780.206113:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512553984 00000100:00100000:2.0:1789135780.206122:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512553984 00000100:00100000:2.0:1789135780.206177:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:2.0:1789135780.206186:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+10:10815:x1876044512553984:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135780.206201:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135780.206217:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3717 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.206261:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.206270:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135780.206274:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135780.206279:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.206307:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.206319:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 11 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.206332:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ee940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545077760:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135780.206466:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc137ec240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.208888:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ee940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545077760:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135780.208918:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.208934:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3800, rc 0) 00000100:00100000:0.0:1789135780.209034:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+11:10815:x1876044512553984:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2848us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.209043:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:1.0:1789135780.209126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.209322:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512554112 00000100:00100000:3.0:1789135780.209329:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512554112 00010000:00010000:3.0:1789135780.209358:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 11 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.209431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:3.0:1789135780.209451:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05777850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+11:2375:x1876044512554112:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135780.209464:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135780.209487:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 11 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.209500:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 11 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.209523:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001de5121c/0x5b09da6ee1ce47f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3710 expref: 11 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.209535:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135780.209539:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135780.209546:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.209569:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.209607:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.209623:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1876044545077888:192.168.206.35@tcp:105: 00000100:00100000:3.0:1789135780.209674:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc156c7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.212477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.212586:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1876044545077888:192.168.206.35@tcp:105: 00010000:00010000:3.0:1789135780.212608:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135780.212669:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05777850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2375:x1876044512554112:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 3220us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.212680:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:1.0:1789135780.212912:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512554240 00000100:00100000:1.0:1789135780.212920:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512554240 00002000:00100000:1.0:1789135780.212961:0:6686:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8adc346ecb40 x1876044512554240/t0(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:211/0 lens 504/0 e 0 to 0 dl 1789135791 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135780.213405:0:6686:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc346ecb40 with x1876044512554240 ext(0->12) 00002000:00010000:1.0:1789135780.213411:0:6686:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc346ecb40 00000100:00100000:2.0:1789135780.213482:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1789135780.213493:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2375:x1876044512554240:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789135780.213954:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+12:2375:x1876044512554240:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 Request processed in 462us (1483us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789135780.213962:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00002000:00100000:2.0:1789135780.213981:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8adc346ecb40 x1876044512554240/t4294967308(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:211/0 lens 504/448 e 0 to 0 dl 1789135791 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135780.213990:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc346ecb40 with x1876044512554240 ext(0->12) 00002000:00010000:2.0:1789135780.213993:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc346ecb40 00000100:00100000:2.0:1789135780.216154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.216229:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512554368 00000100:00100000:3.0:1789135780.216236:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512554368 00000100:00100000:3.0:1789135780.216323:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 124 00000100:00100000:3.0:1789135780.216333:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+61:10815:x1876044512554368:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789135780.242733:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:2.0:1789135780.242753:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789135780.242769:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adc1a4900c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789135780.242772:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc4131ef00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adc1a4903c0 00000020:00080000:2.0:1789135780.242775:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc4131ea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc34969800 00000004:00080000:2.0:1789135780.242786:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1789135780.242805:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:2.0:1789135780.242815:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1789135780.242818:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1789135780.242822:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789135780.242837:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adc03fca900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789135780.242839:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc079e7e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adc03fca300 00000020:00080000:2.0:1789135780.242841:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc079e7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc3496b000 00000020:00080000:2.0:1789135780.242853:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789135780.243033:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789135780.243182:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135780.243200:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545078016:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789135780.243217:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545078144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789135780.243358:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.243361:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545078272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789135780.243676:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545078016 00000100:00100000:1.0:1789135780.243694:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545078016 00000100:00100000:1.0:1789135780.243759:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135780.243768:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc350303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044545078016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789135780.243792:0:6765:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1789135780.243823:0:6765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa40ba3, atime: 0x6aa40ba3, ctime: 0x6aa40ba3, blocks: 0x1 00010000:00010000:1.0:1789135780.243831:0:6765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.243846:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789135780.243851:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135780.243857:0:6765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.243872:0:6765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.243882:0:6765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.243900:0:6765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.243922:0:6765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135780.244031:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135780.244037:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.244052:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135780.244056:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.244090:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.244107:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.244114:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce4805 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.244132:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135780.244134:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135780.244136:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135780.244327:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.244374:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc350303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044545078016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 606us (1014us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789135780.244381:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789135780.244579:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135780.244835:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545078272 00000100:00100000:1.0:1789135780.244847:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545078272 00000100:00100000:3.0:1789135780.244860:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789135780.244990:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135780.245366:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545078144 00000100:00100000:2.0:1789135780.245371:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545078144 00000100:00100000:1.0:1789135780.245372:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135780.245380:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1876044545078272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789135780.245390:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789135780.245395:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1876044545078144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789135780.245405:0:6681:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1789135780.245420:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.245436:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.245455:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789135780.245458:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135780.245463:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.245494:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.245509:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 11 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.245523:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ee940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876044545078400:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135780.245593:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3a30f0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1789135780.248800:0:6765:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789135780.248809:0:6765:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789135780 00002000:00010000:1.0:1789135780.248812:0:6765:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789135780.248814:0:6765:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789135780 -> 1789135780 00002000:00010000:1.0:1789135780.248816:0:6765:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789135780.249008:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3316:x1876044545078272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3591us (4643us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789135780.249019:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135780.249123:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789135780.249129:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789135780.249148:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc34e58b40, transno 4294967301 00000100:00100000:1.0:1789135780.249168:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8adc340052c0 x1876044545077120/t4294967303(4294967303) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1789135795 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_001.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789135780.249181:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc3496da40/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789135780.249186:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545078016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789135780.249236:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+15:10815:x1876044512554368:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 32902us (33172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.249244:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 124 00000004:00080000:3.0:1789135780.250829:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc3496e940/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789135780.250839:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545078272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789135780.252587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.252684:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ee940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876044545078400:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135780.252704:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.253413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.253829:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512554624 00000100:00100000:3.0:1789135780.253838:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512554624 00000100:00100000:1.0:1789135780.253956:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512554496 00000100:00100000:1.0:1789135780.253961:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512554496 00000100:00100000:3.0:1789135780.254769:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:3.0:1789135780.254783:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+13:2376:x1876044512554624:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789135780.256870:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 13 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.256913:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:1.0:1789135780.256931:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:2375:x1876044512554496:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135780.256944:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135780.256950:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 13 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.256965:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 13 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.257001:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007286fca6/0x5b09da6ee1ce45c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3676 expref: 13 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.257016:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135780.257020:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135780.257025:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.257035:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.257082:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135780.257139:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+12:2375:x1876044512554496:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 212us (4558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.257147:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 61 00010000:00010000:2.0:1789135780.259463:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.259482:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.259493:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.259514:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.259536:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789135780.260139:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3315:x1876044545078144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14740us (15276us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789135780.260150:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1789135780.260420:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc3496f480/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789135780.260428:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545078144:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789135780.265175:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135780.265191:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.265225:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135780.265230:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.265240:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.265259:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.265266:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066279aa7/0x5b09da6ee1ce480c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.265285:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135780.265286:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135780.265288:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135780.283286:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+11:2376:x1876044512554624:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 28497us (29864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.283300:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000001:00080000:0.0:1789135780.283337:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1789135780.283348:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789135780.283354:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1789135780.285872:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.286025:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512554880 00000100:00100000:0.0:1789135780.286034:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512554880 00000100:00100000:0.0:1789135780.286167:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 125 00000100:00100000:0.0:1789135780.286178:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19457840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+15:10815:x1876044512554880:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789135780.286254:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135780.286284:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce47f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3709 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.286304:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135780.286309:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135780.286342:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.286356:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.286365:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135780.286619:0:5838:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c0910430 reply state 000000006950dcb4 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.286628:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135780.286716:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19457840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+16:10815:x1876044512554880:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 540us (851us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789135780.286829:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 125 00000100:00100000:1.0:1789135780.289575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.290147:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512555008 00000100:00100000:0.0:1789135780.290157:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512555008 00000100:00100000:0.0:1789135780.290206:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:0.0:1789135780.290216:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512555008:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789135780.290435:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789135780.290439:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789135780 -> 1789135779 00002000:00010000:0.0:1789135780.290442:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789135779 00002000:00010000:0.0:1789135780.290458:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789135780 -> 1789135779 00002000:00010000:0.0:1789135780.290461:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789135780.290522:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512555008:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 308us (955us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789135780.290530:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00010000:00010000:3.0:1789135780.292194:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.292209:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.292217:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.292223:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135780.292228:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.292236:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.292252:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:3.0:1789135780.292255:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135780.292275:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.292282:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4813 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.294267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135780.294518:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512555264 00000100:00100000:0.0:1789135780.294538:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512555264 00000100:00100000:0.0:1789135780.294822:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:0.0:1789135780.294833:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+15:10815:x1876044512555264:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789135780.295015:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.295031:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.295040:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.295100:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.295113:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 15 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.295127:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35031a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545078528:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135780.295207:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.297981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.298050:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512555392 00000100:00100000:3.0:1789135780.298058:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512555392 00010000:00010000:3.0:1789135780.298130:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 16 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.298162:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:3.0:1789135780.298171:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+16:2375:x1876044512555392:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135780.298185:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135780.298191:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 16 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.298204:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 16 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.298235:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:3.0:1789135780.298240:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.298251:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.298259:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.298276:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135780.298340:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+16:2375:x1876044512555392:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 169us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.298348:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00010000:00010000:0.0:1789135780.298611:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce47d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36fb expref: 15 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.298639:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35031a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545078528:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135780.298660:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298669:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298675:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298700:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298706:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298712:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298718:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135780.298787:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298796:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298806:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135780.298808:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789135780.298812:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.298824:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce481a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.298912:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+14:10815:x1876044512555264:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 Request processed in 4081us (4650us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789135780.298920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 126 00000100:00100000:2.0:1789135780.302282:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.302451:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512555520 00000100:00100000:3.0:1789135780.302460:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512555520 00000100:00100000:3.0:1789135780.302555:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:3.0:1789135780.302566:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2378:x1876044512555520:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789135780.302609:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.302627:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.302637:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135780.302642:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135780.302647:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.302680:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.302694:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 7 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.302708:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876044545078656:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135780.302824:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05334840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.308475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.308485:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876044545078656:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135780.308511:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.308521:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512555648 00000100:00100000:2.0:1789135780.308528:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512555648 00010000:00010000:2.0:1789135780.308574:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 8 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.308611:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:2.0:1789135780.308621:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512555648:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135780.308636:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135780.308657:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 8 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.308671:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 8 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.308711:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce47fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3717 expref: 8 pid: 6682 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.308737:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135780.308742:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135780.308747:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.308756:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.308781:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135780.308826:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512555648:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 206us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.308834:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00010000:00010000:3.0:1789135780.308868:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.308879:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.308906:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.308915:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.308923:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.309005:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135780.309089:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.309101:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.309126:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.309134:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4821 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.309241:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512555520:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 6676us (7026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.309250:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1789135780.311759:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135780.311842:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512555904 00000100:00100000:1.0:1789135780.311850:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512555904 00000100:00100000:1.0:1789135780.311962:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 127 00000100:00100000:1.0:1789135780.311981:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+14:10815:x1876044512555904:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789135780.312050:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.312304:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.312330:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.312541:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.312617:0:11758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 15 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.312626:0:11758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.312657:0:11758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 15 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.312670:0:11758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 15 pid: 7852 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.312690:0:11758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545078784:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135780.312828:0:11758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135780.316301:0:11758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545078784:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135780.316327:0:11758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.316457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.316515:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512556032 00000100:00100000:3.0:1789135780.316522:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512556032 00010000:00010000:3.0:1789135780.316610:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 16 pid: 7852 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.316674:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:3.0:1789135780.316685:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+16:2375:x1876044512556032:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135780.316699:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135780.316706:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 16 pid: 7852 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.316718:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 16 pid: 7852 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.316794:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce47e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3702 expref: 16 pid: 7852 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.316827:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:3.0:1789135780.316832:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.316840:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.316848:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.316940:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135780.316996:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+15:2375:x1876044512556032:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 313us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.317004:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00010000:00010000:1.0:1789135780.317326:0:11758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.317335:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135780.317496:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789135780.317678:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789135780.317719:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789135780.317843:0:11758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11758:1876044545078912:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789135780.317890:0:11758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.317987:0:11758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.318021:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545078912 00000100:00100000:0.0:1789135780.318025:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545078912 00000100:00100000:0.0:1789135780.318056:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135780.318180:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11758:x1876044545078912:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789135780.318284:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11758:x1876044545078912:12345-0@lo:1000:mdt00_004.0 Request processed in 222us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.318289:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135780.318342:0:11758:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789135780.318346:0:11758:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1789135780.318360:0:11758:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc3496e940, transno 4294967309 00000100:00100000:1.0:1789135780.318373:0:11758:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8adc3496f480 x1876044545078144/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789135796 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135780.318381:0:11758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11758:1876044545078912:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1789135780.318781:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789135780.318828:0:11758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11758:1876044545079040:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789135780.318859:0:11758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.318885:0:11758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.319024:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545079040 00000100:00100000:0.0:1789135780.319029:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545079040 00000100:00100000:0.0:1789135780.319088:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135780.319097:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11758:x1876044545079040:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789135780.319258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:11758:x1876044545079040:12345-0@lo:1000:mdt00_004.0 Request processed in 161us (397us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789135780.319265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135780.319735:0:11758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11758:1876044545079040:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1789135780.319761:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319771:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319779:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319784:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135780.319796:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319803:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319817:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:1.0:1789135780.319820:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135780.319824:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319830:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce482f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319854:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319860:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319866:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319871:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135780.319874:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319880:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319888:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135780.319890:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135780.319902:0:11758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36e6 expref: 18 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319912:0:11758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36e6 expref: 18 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319920:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36e6 expref: 18 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.319944:0:11758:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36e6 expref: 18 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.319955:0:11758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545079168:192.168.206.35@tcp:105: 00000100:00100000:1.0:1789135780.320029:0:11758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.322456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.322521:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512556160 00000100:00100000:3.0:1789135780.322528:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512556160 00000100:00100000:3.0:1789135780.322591:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:3.0:1789135780.322601:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10814:x1876044512556160:12345-192.168.206.35@tcp:49:lfs.0 00000100:00100000:3.0:1789135780.322709:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+19:10814:x1876044512556160:12345-192.168.206.35@tcp:49:lfs.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.322716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:1.0:1789135780.323046:0:11758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ea580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545079168:192.168.206.35@tcp:105: 00010000:00010000:1.0:1789135780.323085:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323095:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4772 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323124:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323139:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323148:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323174:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323180:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323186:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323192:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135780.323195:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323201:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323212:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135780.323215:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135780.323219:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323224:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4836 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323234:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323240:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323246:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323256:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135780.323260:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323266:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323275:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135780.323277:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135780.323280:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.323285:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce4828 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.323491:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+18:10815:x1876044512555904:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 11519us (11739us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789135780.323500:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 127 00000020:00080000:1.0:1789135780.323504:0:11758:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789135780.323529:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135780.323533:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135780.324302:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789135780.324311:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135780.329685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.330098:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512556416 00000100:00100000:3.0:1789135780.330108:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512556416 00000100:00100000:3.0:1789135780.330170:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:3.0:1789135780.330179:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+18:10815:x1876044512556416:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789135780.332507:0:5839:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789135780.332641:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1789135780.332706:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.332724:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.332736:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.332745:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.332751:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.332757:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.332830:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789135780.332962:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+20:10815:x1876044512556416:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 2773us (3273us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789135780.332982:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 32 00000020:00080000:3.0:1789135780.332987:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789135780.333297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.333581:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512556672 00000100:00100000:3.0:1789135780.333588:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512556672 00000100:00100000:3.0:1789135780.333641:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 128 00000100:00100000:3.0:1789135780.333651:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35031a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+20:10814:x1876044512556672:12345-192.168.206.35@tcp:58:lfs.0 00000040:00080000:3.0:1789135780.334166:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789135780.334230:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35031a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+20:10814:x1876044512556672:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 579us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.334250:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 128 00010000:00010000:1.0:1789135780.334671:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135780.334679:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.334688:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135780.334693:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.334703:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.334728:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135780.334732:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789135780.334737:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.334743:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce483d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.334761:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135780.334763:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135780.334765:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135780.355510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135780.355617:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512556800 00000100:00100000:3.0:1789135780.355627:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512556800 00000100:00100000:3.0:1789135780.355718:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 129 00000100:00100000:3.0:1789135780.355738:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+20:10818:x1876044512556800:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135780.355761:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135780.355780:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d371e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.355839:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.355854:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.355870:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.355885:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.355892:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.355899:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.356239:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.356260:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.356269:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.356300:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.356313:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 21 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.356326:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545079296:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135780.356406:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05334a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135780.358583:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545079296:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135780.358608:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.360743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135780.361331:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512557056 00000100:00100000:2.0:1789135780.361341:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512557056 00000100:00100000:2.0:1789135780.361436:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:2.0:1789135780.361447:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35032940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+22:5617:x1876044512557056:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789135780.361695:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35032940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+23:5617:x1876044512557056:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 250us (959us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789135780.361721:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:3.0:1789135780.364521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135780.364916:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512557184 00000100:00100000:1.0:1789135780.364925:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512557184 00010000:00010000:1.0:1789135780.364960:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 23 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.365011:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:1.0:1789135780.365021:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+23:2376:x1876044512557184:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135780.365036:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135780.365043:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 23 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.365055:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 23 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.365270:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4764 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36df expref: 23 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.365306:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135780.365311:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.365320:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.365326:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.365458:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135780.365520:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+22:2376:x1876044512557184:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 499us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.365537:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:1.0:1789135780.366862:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135780.366879:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545079424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135780.366938:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.366986:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545079424 00000100:00100000:1.0:1789135780.366992:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545079424 00000100:00100000:1.0:1789135780.367024:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135780.367031:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044545079424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135780.367049:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789135780.367100:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044545079424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.367106:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135780.367165:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545079424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135780.367673:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367684:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135780.367800:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789135780.367805:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135780.367827:0:5837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367840:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367849:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367855:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367862:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367868:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135780.367872:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367879:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367891:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:0.0:1789135780.367894:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135780.367979:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367986:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce484b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.367999:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368006:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368012:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368018:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135780.368021:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368026:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368034:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8adc02cc5c00) 00010000:00010000:0.0:1789135780.368036:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135780.368039:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368045:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368103:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d371e expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368293:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d371e expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.368302:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:0.0:1789135780.368305:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135780.368308:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31ee00, rc 0) 00000100:00100000:1.0:1789135780.368456:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+21:10818:x1876044512556800:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 12719us (12953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.368470:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 129 00010000:00010000:2.0:1789135780.558232:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789135781.033271:0:12487:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135781.033279:0:12487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135781.033319:0:12487:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789135781.033324:0:12487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789135781.388356:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135781.388365:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135781.388400:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789135781.388406:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135781.388515:0:12074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35030f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545079552:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135781.388613:0:12074:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772180 going to sleep for 11 seconds 00000100:00100000:0.0:1789135781.391322:0:12074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35030f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545079552:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135781.394554:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135781.395342:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512557312 00000100:00100000:1.0:1789135781.395352:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512557312 00000100:00100000:1.0:1789135781.395443:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 130 00000100:00100000:1.0:1789135781.395454:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35030f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+21:10830:x1876044512557312:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789135781.395488:0:11758:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789135781.395591:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35030f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+21:10830:x1876044512557312:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 139us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135781.395598:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 130 00000100:00080000:0.0:1789135781.396008:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135781.400468:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135781.400531:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512557568 00000100:00100000:0.0:1789135781.400540:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512557568 00000100:00100000:0.0:1789135781.400595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 131 00000100:00100000:0.0:1789135781.400605:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+21:10830:x1876044512557568:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135781.400623:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135781.400640:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3725 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135781.400725:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135781.400756:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135781.400768:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135781.400779:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789135781.400907:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42044000/0x5b09da6ee1ce4860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3725 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135781.400926:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3725 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135781.400934:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:0.0:1789135781.400937:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135781.400941:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045e00, rc 0) 00000100:00100000:0.0:1789135781.401116:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+23:10830:x1876044512557568:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 511us (654us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789135781.401123:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 131 00000100:00100000:3.0:1789135781.403912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135781.403956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135781.404051:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512557952 00000100:00100000:2.0:1789135781.404088:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512557952 00000100:00100000:2.0:1789135781.404149:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1789135781.404159:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+23:2377:x1876044512557952:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135781.404174:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135781.404198:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3725 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135781.404215:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:2.0:1789135781.404219:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135781.404268:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+22:2377:x1876044512557952:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135781.404276:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:1.0:1789135781.404433:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512557824 00000100:00100000:1.0:1789135781.404439:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512557824 00000100:00100000:1.0:1789135781.404479:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 132 00000100:00100000:1.0:1789135781.404488:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+22:10830:x1876044512557824:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789135781.404561:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404575:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404586:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404754:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404762:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404784:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404789:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135781.404793:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404800:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404821:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135781.404824:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135781.404828:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135781.404833:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4875 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135781.404952:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+23:10830:x1876044512557824:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 465us (1048us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789135781.404960:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 132 00000040:00080000:0.0:1789135781.405214:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135781.405219:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135781.405716:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789135781.405725:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135781.406588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135781.406659:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512558208 00000100:00100000:2.0:1789135781.406666:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512558208 00000100:00100000:2.0:1789135781.406745:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:2.0:1789135781.406755:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+23:10830:x1876044512558208:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789135781.406941:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+24:10830:x1876044512558208:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 187us (355us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789135781.406949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00010000:00010000:1.0:1789135781.580339:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135782.606051:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135782.624386:0:12538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135782.624394:0:12538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135782.624520:0:12538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789135782.624526:0:12538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135782.800416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135782.800593:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512558464 00000100:00100000:3.0:1789135782.800604:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512558464 00000100:00100000:2.0:1789135782.800925:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 133 00000100:00100000:2.0:1789135782.800935:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+24:10850:x1876044512558464:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135782.800968:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135782.800987:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce487c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d372c expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135782.801086:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4883 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135782.801100:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4883 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135782.801110:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4883 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135782.801120:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789135782.801342:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce487c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d372c expref: 27 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135782.801360:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4883 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d372c expref: 26 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135782.801367:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:2.0:1789135782.801370:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789135782.801374:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2c00, rc 0) 00000100:00100000:2.0:1789135782.801430:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+26:10850:x1876044512558464:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 496us (1023us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789135782.801438:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 133 00000100:00100000:0.0:1789135782.805592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135782.805866:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512558592 00000100:00100000:1.0:1789135782.805875:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512558592 00000100:00100000:1.0:1789135782.805985:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 134 00000100:00100000:1.0:1789135782.805997:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35033840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+26:10850:x1876044512558592:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1789135782.806078:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806106:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806117:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806143:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806149:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806155:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806161:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135782.806165:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806172:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806182:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135782.806185:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135782.806190:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135782.806196:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135782.806275:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35033840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+26:10850:x1876044512558592:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 281us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135782.806289:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 134 00000100:00100000:3.0:1789135782.874622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135782.875153:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512558720 00000100:00100000:0.0:1789135782.875163:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512558720 00000100:00100000:0.0:1789135782.875235:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:0.0:1789135782.875246:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512558720:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:0.0:1789135782.875265:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135782.875285:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5a596d/0x5b09da6ee1ce4898 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3733 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135782.875313:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa40ba3, atime: 0x6aa40ba3, ctime: 0x6aa40ba3, blocks: 0xb 00010000:00010000:0.0:1789135782.875331:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1789135782.875335:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135782.875345:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5a596d/0x5b09da6ee1ce4898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3733 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135782.875365:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c5a596d/0x5b09da6ee1ce4898 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3733 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135782.875378:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42044000, rc 0) 00000100:00100000:0.0:1789135782.875438:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512558720:12345-192.168.206.35@tcp:101:cat.0 Request processed in 194us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135782.875445:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00080000:2.0:1789135782.875522:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135782.878644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135782.878764:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512558848 00000100:00100000:2.0:1789135782.878773:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512558848 00002000:00100000:2.0:1789135782.878819:0:6685:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8adc3496ed00 x1876044512558848/t0(0) o3->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:213/0 lens 488/0 e 0 to 0 dl 1789135793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135782.878830:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3496ed00 with x1876044512558848 ext(0->4095) 00002000:00010000:2.0:1789135782.878836:0:6685:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc3496ed00 00000100:00100000:2.0:1789135782.878868:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:2.0:1789135782.878878:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2378:x1876044512558848:12345-192.168.206.35@tcp:3:cat.0 00000100:00100000:2.0:1789135782.879123:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2378:x1876044512558848:12345-192.168.206.35@tcp:3:cat.0 Request processed in 246us (486us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789135782.879131:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00002000:00100000:2.0:1789135782.879138:0:6685:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8adc3496ed00 x1876044512558848/t0(0) o3->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:213/0 lens 488/4536 e 0 to 0 dl 1789135793 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135782.879147:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3496ed00 with x1876044512558848 ext(0->4095) 00002000:00010000:2.0:1789135782.879151:0:6685:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc3496ed00 00010000:00010000:2.0:1789135783.628146:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135783.949232:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545079680:0@lo:400:kworker.0 00000100:00100000:1.0:1789135783.949303:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135783.953076:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35030b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545080192:0@lo:400:kworker.0 00000100:00100000:1.0:1789135783.953148:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135783.953177:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135783.953184:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35030780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545080064:0@lo:400:kworker.0 00000100:00100000:1.0:1789135783.953209:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135783.953250:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545080064 00000100:00100000:1.0:1789135783.953258:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545080064 00000100:00100000:1.0:1789135783.953318:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135783.953328:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044545080064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135783.953375:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044545080064:12345-0@lo:400:kworker.0 Request processed in 49us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135783.953382:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1789135783.953410:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135783.953434:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35030780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545080064:0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.953713:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35032d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545079808:0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.953782:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135783.953806:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545080320:0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.953830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135783.953850:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135783.953857:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc350312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545079936:0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.953878:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135783.953906:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545080320 00000100:00100000:3.0:1789135783.953910:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545080320 00000100:00100000:3.0:1789135783.953942:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789135783.953963:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1876044545080320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.954000:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1876044545080320:12345-0@lo:400:kworker.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135783.954007:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789135783.954025:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545080192 00000100:00100000:3.0:1789135783.954029:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545080192 00000100:00100000:3.0:1789135783.954053:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545079808 00000100:00100000:3.0:1789135783.954056:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545079808 00000100:00100000:3.0:1789135783.954099:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545079936 00000100:00100000:3.0:1789135783.954103:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545079936 00000100:00100000:3.0:1789135783.954117:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135783.954123:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545080192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.954160:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545080192:12345-0@lo:400:kworker.0 Request processed in 36us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135783.954166:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135783.954176:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789135783.954182:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545079808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.954222:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545079808:12345-0@lo:400:kworker.0 Request processed in 40us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135783.954228:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789135783.954237:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789135783.954243:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545079936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.954262:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545079936:12345-0@lo:400:kworker.0 Request processed in 20us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135783.954267:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1789135783.954294:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135783.954297:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135783.954324:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc350312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545079936:0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.954334:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35032d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545079808:0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.954342:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545080320:0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.954366:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35030b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545080192:0@lo:400:kworker.0 00000100:00100000:2.0:1789135783.960864:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545079680 00000100:00100000:2.0:1789135783.960877:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545079680 00000100:00100000:3.0:1789135783.962376:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789135783.962390:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545079680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135783.962500:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545079680:12345-0@lo:400:kworker.0 Request processed in 113us (13196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135783.962509:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789135783.962544:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545079680:0@lo:400:kworker.0 00000100:00100000:1.0:1789135784.460802:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135784.460823:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35030b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545080448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135784.460884:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135784.461221:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545080448 00000100:00100000:1.0:1789135784.461228:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545080448 00000100:00100000:1.0:1789135784.461270:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135784.461280:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35032d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1876044545080448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135784.461309:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135784.461358:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35032d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1876044545080448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135784.461366:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135784.461719:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35030b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545080448:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789135784.519711:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789135784.519881:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1789135784.519971:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1789135784.656130:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135784.885352:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135784.885405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135784.885449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135784.885456:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512559104 00000100:00100000:0.0:1789135784.885467:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512559104 00000100:00100000:3.0:1789135784.885490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135784.885526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135784.885554:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 167 00000100:00100000:0.0:1789135784.885566:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34004f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+26:2376:x1876044512559104:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135784.885575:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512559360 00000100:00100000:3.0:1789135784.885581:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512559360 00000100:00100000:3.0:1789135784.885616:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512559232 00000100:00100000:3.0:1789135784.885620:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512559232 00000100:00100000:0.0:1789135784.885647:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34004f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+26:2376:x1876044512559104:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135784.885651:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:3.0:1789135784.885667:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512559360:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135784.885668:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 167 00000100:00100000:0.0:1789135784.885688:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512559488 00000100:00100000:0.0:1789135784.885693:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512559488 00000100:00100000:3.0:1789135784.885706:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512559360:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 45us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135784.885714:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:0.0:1789135784.885725:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 168 00000100:00100000:3.0:1789135784.885737:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:0.0:1789135784.885737:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc340d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512559488:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135784.885763:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512559232:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135784.885774:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc340d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2376:x1876044512559488:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 41us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135784.885783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 168 00000100:00100000:3.0:1789135784.885799:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512559232:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 39us (307us total) trans 0 rc 0/0 00000100:00080000:0.0:1789135784.885803:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135784.885808:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00080000:0.0:1789135784.885809:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135784.885814:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135784.886129:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512558976 00000100:00100000:2.0:1789135784.886134:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512558976 00000100:00100000:2.0:1789135784.886171:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 325 00000100:00100000:2.0:1789135784.886179:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512558976:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135784.886218:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512558976:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 40us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135784.886233:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 325 00000040:00080000:1.0:1789135785.486495:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135785.486503:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135785.486566:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789135785.486572:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135785.490718:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545080576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135785.490860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135785.491280:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545080576 00000100:00100000:0.0:1789135785.491287:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545080576 00000100:00100000:0.0:1789135785.491345:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789135785.491355:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc35030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044545080576:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789135785.491405:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789135785.491422:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135785.497125:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc35030b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044545080576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5762us (6256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135785.497141:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789135785.516023:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34e58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545080576:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789135785.583904:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:2.0:1789135785.583925:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1789135785.583934:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adc06711540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789135785.583947:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc4131ee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adc067119c0 00000020:00080000:2.0:1789135785.583951:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc4131ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc348c7000 00000020:00080000:3.0:1789135785.583988:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1789135785.584172:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:2.0:1789135785.584294:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1789135785.584306:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1789135785.604887:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1789135785.604903:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1789135785.677055:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135786.000296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135786.000445:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512559616 00000100:00100000:0.0:1789135786.000455:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512559616 00000100:00100000:0.0:1789135786.000561:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 135 00000100:00100000:0.0:1789135786.000574:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:10495:x1876044512559616:12345-192.168.206.35@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789135786.000701:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:10495:x1876044512559616:12345-192.168.206.35@tcp:60:lhsmtool_posix.0 Request processed in 130us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135786.000709:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 135 00000100:00080000:2.0:1789135786.001047:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135786.003721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135786.003908:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512559872 00000100:00100000:0.0:1789135786.003917:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512559872 00000100:00100000:0.0:1789135786.003982:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:0.0:1789135786.003992:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:10495:x1876044512559872:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789135786.004567:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+14:10495:x1876044512559872:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 568us (845us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789135786.004579:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:3.0:1789135786.171890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135786.172016:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512560000 00000100:00100000:0.0:1789135786.172024:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512560000 00000100:00100000:0.0:1789135786.172170:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 136 00000100:00100000:0.0:1789135786.172181:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:11302:x1876044512560000:12345-192.168.206.35@tcp:101:lsof.0 00010000:00010000:0.0:1789135786.172200:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135786.172229:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce489f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d373a expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135786.172288:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135786.172302:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135786.172314:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135786.172486:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789135786.172490:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135786.172569:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135786.172590:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce489f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 7 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135786.172604:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 6 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135786.172612:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:0.0:1789135786.172614:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135786.172617:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045e00, rc 0) 00000100:00100000:0.0:1789135786.172673:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:11302:x1876044512560000:12345-192.168.206.35@tcp:101:lsof.0 Request processed in 494us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135786.172679:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 136 00000100:00080000:2.0:1789135786.173434:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789135786.700176:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135787.725278:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135788.748293:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135789.071952:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545080832:0@lo:400:kworker.0 00000100:00100000:0.0:1789135789.071952:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545081088:0@lo:400:kworker.0 00000100:00100000:3.0:1789135789.072023:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc35030780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545080704:0@lo:400:kworker.0 00000100:00100000:1.0:1789135789.079972:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.080093:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545081344:0@lo:400:kworker.0 00000100:00100000:1.0:1789135789.080137:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.080178:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135789.080186:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc057fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545080960:0@lo:400:kworker.0 00000100:00100000:1.0:1789135789.080210:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.080278:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545080832 00000100:00100000:1.0:1789135789.080290:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545080832 00000100:00100000:1.0:1789135789.080362:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545080960 00000100:00100000:1.0:1789135789.080365:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545080960 00000100:00100000:1.0:1789135789.080403:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789135789.080413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545080832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135789.080486:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545080832:12345-0@lo:400:kworker.0 Request processed in 75us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.080495:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789135789.080534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789135789.080541:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545080960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135789.080569:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545080960:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.080575:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789135789.080596:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545081344 00000100:00100000:1.0:1789135789.080600:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545081344 00000100:00100000:1.0:1789135789.080637:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789135789.080644:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545081344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135789.080677:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545081344:12345-0@lo:400:kworker.0 Request processed in 34us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.080684:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789135789.080709:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135789.080714:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135789.080776:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc057fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545080960:0@lo:400:kworker.0 00000100:00100000:1.0:1789135789.080789:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545080832:0@lo:400:kworker.0 00000100:00100000:1.0:1789135789.080797:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789135789.080803:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1789135789.080827:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc3496da40, transno 4294967304 00000100:00100000:1.0:1789135789.080847:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545081344:0@lo:400:kworker.0 00000100:00100000:0.0:1789135789.086656:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.090397:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545081088 00000100:00100000:1.0:1789135789.090420:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545081088 00000100:00100000:1.0:1789135789.090539:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789135789.090551:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545081088:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789135789.090578:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135789.090685:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545081088:12345-0@lo:400:kworker.0 Request processed in 136us (4037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.090694:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789135789.090767:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789135789.090774:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc3496f480, transno 4294967310 00000004:00080000:0.0:1789135789.090790:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1789135789.090821:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545081088:0@lo:400:kworker.0 00000100:00100000:2.0:1789135789.104277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.104364:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545081216:0@lo:400:kworker.0 00000100:00100000:2.0:1789135789.104423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.104664:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545080704 00000100:00100000:3.0:1789135789.104673:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545080704 00000100:00100000:3.0:1789135789.104761:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789135789.104772:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545080704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135789.104840:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545080704:12345-0@lo:400:kworker.0 Request processed in 70us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.104858:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789135789.106018:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc35030780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545080704:0@lo:400:kworker.0 00000100:00100000:0.0:1789135789.107138:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545081216 00000100:00100000:0.0:1789135789.107151:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545081216 00000100:00100000:3.0:1789135789.107515:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789135789.107528:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545081216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135789.107647:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545081216:12345-0@lo:400:kworker.0 Request processed in 122us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.107655:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1789135789.108549:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135789.109116:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545081216:0@lo:400:kworker.0 00000100:00100000:0.0:1789135789.584770:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135789.584803:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545081472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135789.584891:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.585013:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545081472 00000100:00100000:0.0:1789135789.585022:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545081472 00000100:00100000:0.0:1789135789.585107:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789135789.585118:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545081472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135789.585163:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135789.585226:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545081472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.585236:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789135789.585298:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545081472:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789135789.618257:0:12740:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:09:48 (1789135788) 00010000:00010000:2.0:1789135789.772275:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135790.009221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135790.009338:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512560128 00000100:00100000:1.0:1789135790.009346:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512560128 00000100:00100000:1.0:1789135790.009396:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 327 00000100:00100000:1.0:1789135790.009407:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512560128:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135790.009552:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512560128:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135790.009560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 327 00000100:00100000:0.0:1789135790.010754:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135790.011330:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512560256 00000100:00100000:3.0:1789135790.011337:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512560256 00000100:00100000:3.0:1789135790.011427:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 172 00000100:00100000:3.0:1789135790.011439:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+14:2375:x1876044512560256:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135790.011508:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+14:2375:x1876044512560256:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 74us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135790.011515:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 172 00000100:00080000:0.0:1789135790.012607:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135790.015814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135790.015853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135790.015887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135790.015930:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512560512 00000100:00100000:2.0:1789135790.015940:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512560512 00000100:00100000:3.0:1789135790.015972:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512560384 00000100:00100000:3.0:1789135790.015978:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512560384 00000100:00100000:2.0:1789135790.016014:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 95 00000100:00100000:3.0:1789135790.016084:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 96 00000100:00100000:3.0:1789135790.016096:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512560384:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135790.016102:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512560512:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135790.016172:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512560512:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 149us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.016181:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 95 00000100:00100000:3.0:1789135790.016249:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512560384:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 156us (393us total) trans 0 rc 0/0 00000100:00080000:1.0:1789135790.016341:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135790.016345:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135790.016406:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512560640 00000100:00100000:0.0:1789135790.016411:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512560640 00000100:00080000:1.0:1789135790.016489:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135790.016568:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 173 00000100:00100000:0.0:1789135790.016577:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2376:x1876044512560640:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135790.016608:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2376:x1876044512560640:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 33us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135790.016615:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 173 00000100:00100000:3.0:1789135790.016777:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 96 00000100:00100000:3.0:1789135790.604291:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545081600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135790.604360:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135790.604579:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545081600 00000100:00100000:1.0:1789135790.604587:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545081600 00000100:00100000:1.0:1789135790.604636:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789135790.604646:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545081600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135790.604692:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135790.604746:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545081600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135790.604754:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789135790.605988:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545081600:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789135790.669723:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789135790.669742:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789135790.669764:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789135790.669781:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789135790.797097:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135791.196655:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135791.196751:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512560896 00000100:00100000:3.0:1789135791.196766:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512560896 00000100:00100000:3.0:1789135791.196825:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 137 00000100:00100000:3.0:1789135791.196833:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+13:11567:x1876044512560896:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135791.196851:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135791.196867:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce48ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3741 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135791.196939:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135791.196953:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135791.196964:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135791.196977:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135791.196985:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135791.196991:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.208823:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce48c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.208845:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce48c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.208856:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce48c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135791.208870:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789135791.210239:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.210260:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211414:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211422:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135791.211427:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211492:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211511:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8adc1953cc00) 00010000:00010000:2.0:1789135791.211514:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135791.211519:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211526:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce48b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211560:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211567:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211572:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211577:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135791.211580:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211586:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211595:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8adc02cc5c00) 00010000:00010000:2.0:1789135791.211597:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135791.211601:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.211606:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce48bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.212117:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce48ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3741 expref: 16 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.212133:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce48c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3741 expref: 15 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135791.212151:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:2.0:1789135791.212153:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135791.212156:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2800, rc 0) 00000100:00100000:2.0:1789135791.213152:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+15:11567:x1876044512560896:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 16313us (16499us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789135791.213163:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 137 00000100:00100000:2.0:1789135791.217775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135791.217819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135791.217973:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512561024 00000100:00100000:1.0:1789135791.217973:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512561152 00000100:00100000:3.0:1789135791.217982:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512561024 00000100:00100000:1.0:1789135791.217982:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512561152 00000100:00100000:3.0:1789135791.218040:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1789135791.218050:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05774050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+16:2377:x1876044512561024:12345-192.168.206.35@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789135791.218091:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 138 00010000:00010000:3.0:1789135791.218094:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789135791.218098:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+16:11567:x1876044512561152:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 00010000:00010000:3.0:1789135791.218127:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce48c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3741 expref: 16 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135791.218144:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:3.0:1789135791.218148:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135791.219097:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+15:11567:x1876044512561152:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 Request processed in 995us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135791.219108:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 138 00000100:00100000:3.0:1789135791.219164:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05774050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+14:2377:x1876044512561024:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 1115us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135791.219172:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000040:00080000:2.0:1789135791.628369:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135791.628377:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135791.628973:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789135791.628981:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789135791.822496:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135792.785204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135792.786246:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512561280 00000100:00100000:0.0:1789135792.786256:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512561280 00000100:00100000:0.0:1789135792.786375:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 139 00000100:00100000:0.0:1789135792.786386:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+14:11609:x1876044512561280:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135792.786419:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135792.786441:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce48d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3748 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786514:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786530:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786543:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786559:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786566:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786574:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786810:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786818:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786824:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786830:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135792.786838:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786845:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786856:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:0.0:1789135792.786859:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135792.786863:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786869:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce48d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786879:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786884:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786890:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786895:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135792.786898:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786914:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786921:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adc062d3800) 00010000:00010000:0.0:1789135792.786924:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135792.786932:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786938:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce48de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786967:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce48d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3748 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786976:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:0.0:1789135792.786979:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135792.786982:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce48d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3748 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135792.786990:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045000, rc 0) 00000100:00100000:0.0:1789135792.787045:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+14:11609:x1876044512561280:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 661us (1850us total) trans 0 rc 301/301 00000100:00100000:0.0:1789135792.787052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 139 00000100:00080000:2.0:1789135792.791039:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135792.793754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135792.793825:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512561536 00000100:00100000:3.0:1789135792.793834:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512561536 00000100:00100000:3.0:1789135792.793890:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 140 00000100:00100000:3.0:1789135792.794006:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+14:11609:x1876044512561536:12345-192.168.206.35@tcp:36:lfs.0 00010000:00010000:3.0:1789135792.794054:0:7852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135792.794098:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce424e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3581 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.794115:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:3.0:1789135792.794120:0:7852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135792.794352:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.794366:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 5 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.794375:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.794402:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 5 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.794421:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 5 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135792.794435:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc19454000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545081728:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135792.794560:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135792.799623:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc19454000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545081728:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135792.799656:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135792.801003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135792.801094:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512561664 00000100:00100000:3.0:1789135792.801102:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512561664 00010000:00010000:3.0:1789135792.801164:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 6 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135792.801197:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:3.0:1789135792.801208:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3efc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2375:x1876044512561664:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135792.801223:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135792.801229:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 6 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801242:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 6 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801263:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce48a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d373a expref: 6 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801293:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:3.0:1789135792.801298:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801307:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801314:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801336:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135792.801382:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3efc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2375:x1876044512561664:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 175us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135792.801391:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 66 00010000:00010000:3.0:1789135792.801467:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801475:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801610:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801620:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.801628:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789135792.802865:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1789135792.804419:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789135792.804443:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.804452:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.804461:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.804467:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135792.804471:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.804495:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.804512:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5700) 00010000:00010000:3.0:1789135792.804515:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135792.804520:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.804527:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce48e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135792.804545:0:7852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e2f871aa reply state 0000000056899695 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135792.804553:0:7852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135792.804642:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+15:11609:x1876044512561536:12345-192.168.206.35@tcp:36:lfs.0 Request processed in 10741us (10893us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789135792.804652:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 140 00010000:00010000:2.0:1789135792.808619:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135792.808635:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135792.808642:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135792.808649:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ea00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135792.808653:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135792.808660:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135792.808688:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adc02cc5200) 00010000:00010000:2.0:1789135792.808691:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135792.808695:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135792.808702:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce48ec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135792.845165:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135792.907819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135792.908444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512561792 00000100:00100000:1.0:1789135792.908453:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512561792 00000100:00100000:1.0:1789135792.908646:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 141 00000100:00100000:1.0:1789135792.908656:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+14:11617:x1876044512561792:12345-192.168.206.35@tcp:101:lctl.0 00010000:00010000:1.0:1789135792.908678:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135792.908699:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce48f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d374f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.908759:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce48fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.908779:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce48fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.908790:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce48fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135792.908842:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789135792.908845:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135792.908881:0:5837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce48fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.908911:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce48f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d374f expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.908927:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce48fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d374f expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.908935:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:1.0:1789135792.908938:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135792.908941:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481600, rc 0) 00000100:00100000:1.0:1789135792.909005:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+15:11617:x1876044512561792:12345-192.168.206.35@tcp:101:lctl.0 Request processed in 350us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135792.909012:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 141 00000100:00100000:0.0:1789135792.972753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135792.972840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512561920 00000100:00100000:3.0:1789135792.972848:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512561920 00000100:00100000:3.0:1789135792.972930:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 142 00000100:00100000:3.0:1789135792.972940:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+15:11623:x1876044512561920:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1789135792.972959:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135792.972978:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3756 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973036:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973050:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973109:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973126:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973134:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973142:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973651:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e000/0x5b09da6ee1ce4916 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973661:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e000/0x5b09da6ee1ce4916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973685:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e000/0x5b09da6ee1ce4916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135792.973717:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789135792.973721:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135792.973744:0:5836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e000/0x5b09da6ee1ce4916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973755:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973761:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973767:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973773:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fc00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135792.973777:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973784:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973795:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:3.0:1789135792.973798:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135792.973802:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973808:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973830:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973836:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973841:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973847:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135792.973850:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973855:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.973863:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adc02cc5700) 00010000:00010000:3.0:1789135792.973994:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135792.974000:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.974006:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce490f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.974040:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3756 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.974054:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e000/0x5b09da6ee1ce4916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3756 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.974375:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135792.974378:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789135792.974380:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e000, rc 0) 00000100:00100000:3.0:1789135792.974461:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+16:11623:x1876044512561920:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1521us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135792.974469:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 142 00000100:00100000:2.0:1789135792.977814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135792.978056:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512562176 00000100:00100000:3.0:1789135792.978087:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512562176 00000100:00100000:3.0:1789135792.978173:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 143 00000100:00100000:3.0:1789135792.978185:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+16:11623:x1876044512562176:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1789135792.978205:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135792.978225:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce491d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d375d expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.978424:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.978590:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.978601:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.978646:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.978652:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.978669:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135792.979261:0:7852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789135792.979602:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979613:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979622:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979657:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979664:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979671:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979676:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135792.979680:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979688:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979699:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135792.979701:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135792.979713:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979720:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4924 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135792.979734:0:7852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000046969af4 reply state 00000000a50ab088 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135792.979742:0:7852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789135792.979773:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce491d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 19 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979785:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 18 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.979792:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc02cc5600) 00010000:00010000:3.0:1789135792.979795:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135792.979797:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f800, rc 0) 00000100:00100000:3.0:1789135792.979879:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11623:x1876044512562176:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1696us (2073us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789135792.979888:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 143 00010000:00010000:3.0:1789135792.982699:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.982717:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.982725:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.982748:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135792.982752:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.982760:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.982776:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc02cc5d00) 00010000:00010000:3.0:1789135792.982779:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135792.982783:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.982790:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce492b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135792.986011:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135792.986372:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512562304 00000100:00100000:1.0:1789135792.986381:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512562304 00000100:00100000:1.0:1789135792.986452:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:1.0:1789135792.986461:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512562304:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135792.986478:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135792.986509:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3764 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135792.986605:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135792.986623:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1789135792.986627:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135792.986636:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.986654:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.986668:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481400, rc 0) 00000100:00100000:1.0:1789135792.986725:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512562304:12345-192.168.206.35@tcp:101:bash.0 Request processed in 265us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135792.986733:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00080000:0.0:1789135792.986823:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135792.990892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135792.991178:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512562432 00000100:00100000:1.0:1789135792.991188:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512562432 00000100:00100000:1.0:1789135792.991239:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1789135792.991248:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:11623:x1876044512562432:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135792.991263:0:6765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135792.991279:0:6765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d376b expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.991308:0:6765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.991334:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135792.991338:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135792.991344:0:6765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 7 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.991374:0:6765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.991387:0:6765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 7 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135792.991402:0:6765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6765:1876044545081856:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135792.991514:0:6765:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13625540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135792.995812:0:6765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6765:1876044545081856:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135792.995845:0:6765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 7 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135792.995864:0:6765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481000, rc 0) 00000100:00100000:1.0:1789135792.995977:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:11623:x1876044512562432:12345-192.168.206.35@tcp:101:bash.0 Request processed in 4728us (5091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135792.995986:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:2.0:1789135792.997403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135792.997987:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512562560 00000100:00100000:3.0:1789135792.997995:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512562560 00010000:00010000:3.0:1789135792.998034:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 7 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135792.998092:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:3.0:1789135792.998101:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a302580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512562560:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135792.998114:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135792.998134:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 7 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.998148:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 7 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.998193:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4940 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3764 expref: 7 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.998209:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135792.998213:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135792.998221:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 6 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.998231:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 6 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135792.998264:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 6 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135792.998279:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf8780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876044545081984:192.168.206.35@tcp:105: 00000100:00100000:3.0:1789135792.998356:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135793.002798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.003786:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512562816 00000100:00100000:0.0:1789135793.003796:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512562816 00000100:00100000:0.0:1789135793.003853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:0.0:1789135793.003863:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+18:11623:x1876044512562816:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:0.0:1789135793.004213:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11623:x1876044512562816:12345-192.168.206.35@tcp:35:bash.0 Request processed in 350us (1421us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789135793.004221:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:3.0:1789135793.006384:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf8780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876044545081984:192.168.206.35@tcp:105: 00010000:00010000:3.0:1789135793.006414:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135793.006476:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a302580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512562560:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 8376us (9075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135793.014205:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:2.0:1789135793.077226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.081023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512563072 00000100:00100000:1.0:1789135793.081037:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512563072 00000100:00100000:1.0:1789135793.081123:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 144 00000100:00100000:1.0:1789135793.081144:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11633:x1876044512563072:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135793.081167:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135793.081187:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce494e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3772 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135793.081290:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789135793.081396:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce494e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3772 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.081411:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:1.0:1789135793.081414:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135793.081419:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce494e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3772 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.081433:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481c00, rc 0) 00000100:00100000:1.0:1789135793.081499:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a300b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+20:11633:x1876044512563072:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 357us (4283us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1789135793.081507:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 144 00000100:00100000:1.0:1789135793.085053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.085177:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512563328 00000100:00100000:0.0:1789135793.085194:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512563328 00000100:00100000:0.0:1789135793.085238:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:0.0:1789135793.085248:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+20:11633:x1876044512563328:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135793.085499:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+21:11633:x1876044512563328:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 252us (454us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789135793.085508:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:2.0:1789135793.158319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135793.158394:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512563456 00000100:00100000:3.0:1789135793.158402:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512563456 00000100:00100000:3.0:1789135793.158621:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 145 00000100:00100000:3.0:1789135793.158646:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41952580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+21:11639:x1876044512563456:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135793.158679:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135793.158697:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce495c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3779 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.158767:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce4963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.158781:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce4963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.158792:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce4963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135793.158844:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789135793.158849:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135793.158870:0:5836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce4963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.158895:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce495c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3779 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.158921:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce4963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3779 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.158929:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135793.158931:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135793.158934:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f600, rc 0) 00000100:00100000:3.0:1789135793.158992:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41952580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+22:11639:x1876044512563456:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 349us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135793.159007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 145 00000100:00100000:2.0:1789135793.162909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135793.162998:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512563712 00000100:00100000:3.0:1789135793.163007:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512563712 00000100:00100000:3.0:1789135793.163191:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 146 00000100:00100000:3.0:1789135793.163202:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+22:11639:x1876044512563712:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135793.163219:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135793.163236:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce496a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3780 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.163314:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.163326:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.163337:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135793.163346:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789135793.163448:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce496a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3780 expref: 25 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.163604:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3780 expref: 24 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.163613:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc02cc5600) 00010000:00010000:3.0:1789135793.163616:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135793.163619:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f200, rc 0) 00000100:00100000:3.0:1789135793.163757:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11639:x1876044512563712:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 557us (866us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789135793.163765:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 146 00000100:00100000:1.0:1789135793.168977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.169020:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.169218:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512564096 00000100:00100000:0.0:1789135793.169227:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512564096 00000100:00100000:0.0:1789135793.169284:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 147 00000100:00100000:0.0:1789135793.169293:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11639:x1876044512564096:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135793.169316:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135793.169336:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce497f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3787 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.169419:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4986 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.169433:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.169443:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135793.169467:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789135793.169579:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce497f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3787 expref: 27 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.169597:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3787 expref: 26 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.169620:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc02cc5600) 00010000:00010000:0.0:1789135793.169623:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789135793.169627:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045c00, rc 0) 00000100:00100000:0.0:1789135793.169692:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+26:11639:x1876044512564096:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 400us (670us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789135793.169699:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 147 00000100:00100000:3.0:1789135793.171433:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512563840 00000100:00100000:3.0:1789135793.171445:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512563840 00000100:00100000:3.0:1789135793.171581:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:3.0:1789135793.171590:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+26:2377:x1876044512563840:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135793.171608:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135793.171628:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3780 expref: 26 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.171642:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc02cc5600) 00010000:00010000:3.0:1789135793.171646:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135793.171710:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+25:2377:x1876044512563840:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 121us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135793.171717:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1789135793.178568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135793.178779:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512564224 00000100:00100000:2.0:1789135793.178788:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512564224 00000100:00100000:2.0:1789135793.178874:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:2.0:1789135793.178885:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512564224:12345-192.168.206.35@tcp:1:lfs.0 00010000:00010000:2.0:1789135793.178949:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.178969:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 6 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.178994:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135793.178999:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135793.179004:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.179040:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 6 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.179053:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 6 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135793.179098:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc419503c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876044545082112:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135793.179178:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135793.183929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.184125:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512564352 00000100:00100000:0.0:1789135793.184134:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512564352 00002000:00100000:0.0:1789135793.184180:0:6685:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8adc3a2fe1c0 x1876044512564352/t0(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:224/0 lens 504/0 e 0 to 0 dl 1789135804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135793.184192:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3a2fe1c0 with x1876044512564352 ext(0->12) 00010000:00010000:0.0:1789135793.184201:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 7 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.184217:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 7 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135793.184224:0:6685:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc3a2fe1c0 00000100:00100000:0.0:1789135793.184247:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:0.0:1789135793.184256:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512564352:12345-192.168.206.35@tcp:4:lfs.0 00000100:00100000:0.0:1789135793.184763:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512564352:12345-192.168.206.35@tcp:4:lfs.0 Request processed in 506us (840us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789135793.184771:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00002000:00100000:0.0:1789135793.184778:0:6685:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8adc3a2fe1c0 x1876044512564352/t4294967305(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:224/0 lens 504/448 e 0 to 0 dl 1789135804 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135793.184791:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3a2fe1c0 with x1876044512564352 ext(0->12) 00010000:00010000:0.0:1789135793.184797:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 9 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.184809:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 9 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135793.184815:0:6685:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc3a2fe1c0 00000100:00100000:3.0:1789135793.189383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.189492:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512564480 00000100:00100000:0.0:1789135793.189503:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512564480 00010000:00010000:0.0:1789135793.189540:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 9 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135793.189589:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:0.0:1789135793.189599:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512564480:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135793.189615:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789135793.189633:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789135793.189637:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789135793 00002000:00010000:0.0:1789135793.189639:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789135793 00002000:00010000:0.0:1789135793.189641:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789135793 00010000:00010000:0.0:1789135793.189648:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 9 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.189674:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 9 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.189718:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135793.189723:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135793.189729:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.189739:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.189760:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135793.189819:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512564480:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 221us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135793.189827:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 68 00010000:00010000:2.0:1789135793.190715:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4947 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d376b expref: 8 pid: 6765 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135793.190731:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc419503c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876044545082112:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135793.190750:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190760:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190767:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190801:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190808:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190814:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190821:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135793.190824:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190833:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190846:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.190853:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce4994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135793.191401:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512564224:12345-192.168.206.35@tcp:1:lfs.0 Request processed in 12515us (12954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135793.191411:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1789135793.194545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.194640:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512564736 00000100:00100000:0.0:1789135793.194650:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512564736 00000100:00100000:0.0:1789135793.194711:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:0.0:1789135793.194726:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+25:11639:x1876044512564736:12345-192.168.206.35@tcp:35:lfs.0 00000004:00010000:0.0:1789135793.194782:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3787 expref: 25 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135793.195017:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789135793.195106:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789135793.195613:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789135793.195663:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.195678:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 29 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.195698:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.195729:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 29 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.195742:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 29 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135793.195754:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3eda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1876044545082240:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135793.195828:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0553fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135793.199779:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3eda40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1876044545082240:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135793.199807:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135793.200628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135793.200983:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512564864 00000100:00100000:2.0:1789135793.200991:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512564864 00010000:00010000:2.0:1789135793.201025:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 30 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135793.201256:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:2.0:1789135793.201381:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+30:2375:x1876044512564864:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135793.201399:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135793.201407:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 30 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.201419:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 30 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.201440:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f800/0x5b09da6ee1ce4932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d375d expref: 30 pid: 7852 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.201455:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc02cc5600) 00010000:00010000:2.0:1789135793.201460:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.201469:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.201534:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.201614:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135793.201675:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+29:2375:x1876044512564864:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 410us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135793.201693:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00010000:00010000:0.0:1789135793.203464:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.203477:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135793.203647:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789135793.204261:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789135793.204376:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ef480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545082368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135793.204438:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135793.204541:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc033c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135793.204635:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545082368 00000100:00100000:1.0:1789135793.204642:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545082368 00000100:00100000:1.0:1789135793.204798:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135793.204807:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876044545082368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789135793.204908:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876044545082368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135793.204916:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135793.205293:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ef480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545082368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789135793.205817:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789135793.205892:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc419503c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545082496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789135793.205952:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135793.205970:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeb900 going to sleep for 11 seconds 00000100:00080000:0.0:1789135793.206189:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135793.207016:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545082496 00000100:00100000:1.0:1789135793.207024:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545082496 00000100:00100000:1.0:1789135793.207261:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135793.207271:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876044545082496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789135793.207461:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1876044545082496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 192us (1508us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789135793.207468:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789135793.207548:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc419503c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1876044545082496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789135793.207606:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789135793.207642:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.207651:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.207668:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.207673:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135793.207678:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.207685:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.207698:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc02cc5600) 00010000:00010000:2.0:1789135793.207701:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789135793.207705:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.207733:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce499b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135793.207890:0:5840:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789135793.208039:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789135793.208050:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416779986157ns, next at 417779983918ns, rc = 0 00000001:00080000:2.0:1789135793.208056:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789135793.208119:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc02cc5600) 00010000:00010000:2.0:1789135793.208122:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789135793.208129:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4986 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3787 expref: 33 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135793.208627:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11639:x1876044512564736:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 13906us (14087us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789135793.208635:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00000020:00080000:2.0:1789135793.208639:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789135793.211883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.211985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512564992 00000100:00100000:1.0:1789135793.211994:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512564992 00000100:00100000:1.0:1789135793.212046:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 148 00000100:00100000:1.0:1789135793.212056:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11639:x1876044512564992:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135793.212117:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135793.212137:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce49a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d378e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.212202:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce49a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d378e expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.212217:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce49a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d378e expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.212235:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135793.212238:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135793.212255:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481200, rc 0) 00000100:00100000:1.0:1789135793.212299:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+33:11639:x1876044512564992:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 245us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135793.212306:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 148 00000100:00100000:0.0:1789135793.216689:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135793.216994:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512565248 00000100:00100000:2.0:1789135793.217003:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512565248 00000100:00100000:2.0:1789135793.217056:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:2.0:1789135793.217090:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+33:11639:x1876044512565248:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1789135793.217438:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+34:11639:x1876044512565248:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 373us (757us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789135793.217446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:3.0:1789135793.323330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.325016:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512565504 00000100:00100000:0.0:1789135793.325029:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512565504 00000100:00100000:1.0:1789135793.325400:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 149 00000100:00100000:1.0:1789135793.325412:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc04e7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+34:11649:x1876044512565504:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135793.325437:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135793.325455:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce49a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3795 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135793.325816:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789135793.325932:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce49a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3795 expref: 36 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.325948:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:1.0:1789135793.325951:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135793.325957:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce49a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3795 expref: 36 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.325971:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481c00, rc 0) 00000100:00100000:1.0:1789135793.326047:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc04e7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+35:11649:x1876044512565504:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 637us (2725us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789135793.326054:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 149 00000100:00100000:3.0:1789135793.329168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.329747:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512565632 00000100:00100000:1.0:1789135793.329757:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512565632 00000100:00100000:1.0:1789135793.329852:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 150 00000100:00100000:1.0:1789135793.329863:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+35:11649:x1876044512565632:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:1.0:1789135793.329951:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.329965:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.329976:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.329992:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.329999:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330006:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330115:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330124:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330131:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135793.330166:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330177:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330193:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330201:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330206:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135793.330210:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330217:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330227:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135793.330230:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135793.330234:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330239:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce49b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330252:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330258:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330264:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330268:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135793.330276:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330283:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330291:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1953c200) 00010000:00010000:1.0:1789135793.330294:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135793.330297:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330302:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330314:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330320:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330326:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330331:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135793.330334:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330339:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330345:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135793.330348:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135793.330357:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.330363:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135793.330443:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+35:11649:x1876044512565632:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 582us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135793.330452:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 150 00000100:00100000:2.0:1789135793.333271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135793.333368:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512565888 00000100:00100000:3.0:1789135793.333390:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512565888 00000100:00100000:3.0:1789135793.333499:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:3.0:1789135793.333522:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+35:11649:x1876044512565888:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1789135793.333759:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+36:11649:x1876044512565888:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 240us (494us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789135793.333768:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:2.0:1789135793.395724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.395830:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512566144 00000100:00100000:0.0:1789135793.395839:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512566144 00000100:00100000:0.0:1789135793.395919:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 151 00000100:00100000:0.0:1789135793.395929:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+36:11652:x1876044512566144:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135793.395952:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135793.395970:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce49cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d379c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396034:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396047:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396059:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396113:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396121:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396129:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396255:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396264:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396271:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135793.396290:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789135793.396373:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396380:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396386:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396392:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135793.396397:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396404:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396415:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135793.396418:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135793.396423:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396429:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce49d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396442:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396448:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396464:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396470:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135793.396473:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396589:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396599:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc062d3800) 00010000:00010000:0.0:1789135793.396602:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135793.396605:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396611:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce49da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396651:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce49cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396664:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.396671:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:0.0:1789135793.396673:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135793.396675:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045000, rc 0) 00000100:00100000:0.0:1789135793.396840:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a301e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+38:11652:x1876044512566144:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 911us (1124us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789135793.396857:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 151 00000100:00100000:2.0:1789135793.399014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.399085:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512566272 00000100:00100000:1.0:1789135793.399094:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512566272 00000100:00100000:1.0:1789135793.399145:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 152 00000100:00100000:1.0:1789135793.399156:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+38:11652:x1876044512566272:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1789135793.399207:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399222:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399234:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399258:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399265:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399272:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399278:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135793.399288:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399296:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399308:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135793.399311:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135793.399316:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.399322:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135793.399388:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+38:11652:x1876044512566272:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 233us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135793.399395:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 152 00000100:00100000:2.0:1789135793.403095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.403183:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512566528 00000100:00100000:0.0:1789135793.403193:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512566528 00000100:00100000:0.0:1789135793.403254:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:0.0:1789135793.403266:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+38:11652:x1876044512566528:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135793.403528:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+39:11652:x1876044512566528:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 264us (474us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789135793.403537:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:2.0:1789135793.600705:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.600811:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512566784 00000100:00100000:1.0:1789135793.600819:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512566784 00000100:00100000:1.0:1789135793.600878:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 153 00000100:00100000:1.0:1789135793.600888:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3787de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+39:11683:x1876044512566784:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:1.0:1789135793.600924:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135793.600944:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.601033:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.601045:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.601098:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135793.601111:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789135793.601227:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce49f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37a3 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.601240:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37a3 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.601246:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135793.601248:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135793.601251:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481e00, rc 0) 00000100:00100000:1.0:1789135793.601303:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3787de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+41:11683:x1876044512566784:12345-192.168.206.35@tcp:101:cat.0 Request processed in 417us (607us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789135793.601310:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 153 00000100:00100000:2.0:1789135793.603835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135793.603944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135793.604030:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512567168 00000100:00100000:3.0:1789135793.604040:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512567168 00000100:00100000:3.0:1789135793.604131:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:3.0:1789135793.604144:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+41:2376:x1876044512567168:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135793.604169:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135793.604193:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce49fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37a3 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.604210:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:3.0:1789135793.604215:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135793.604265:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+40:2376:x1876044512567168:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 126us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135793.604273:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:0.0:1789135793.605142:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512567040 00000100:00100000:0.0:1789135793.605150:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512567040 00000100:00100000:0.0:1789135793.605441:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:0.0:1789135793.605451:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41908780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+40:11683:x1876044512567040:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:0.0:1789135793.605662:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41908780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+41:11683:x1876044512567040:12345-192.168.206.35@tcp:35:cat.0 Request processed in 213us (1836us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789135793.605670:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:2.0:1789135793.649499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135793.649613:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512567424 00000100:00100000:0.0:1789135793.649622:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512567424 00000100:00100000:0.0:1789135793.649679:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 154 00000100:00100000:0.0:1789135793.649689:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+41:11689:x1876044512567424:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:0.0:1789135793.649712:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135793.649714:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789135793.649739:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f600/0x5b09da6ee1ce4963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3779 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.649758:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135793.649785:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135793.649801:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4a0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37aa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.649891:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.649914:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.649922:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.649951:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.649964:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 41 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135793.649977:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545082624:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135793.650458:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13eac840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135793.652825:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545082624:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135793.652850:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135793.653743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.654385:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512567552 00000100:00100000:1.0:1789135793.654392:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512567552 00010000:00010000:1.0:1789135793.654424:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 42 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135793.654816:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:1.0:1789135793.654837:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05775450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+42:2375:x1876044512567552:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135793.654853:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135793.654861:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 42 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.654892:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 42 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.654928:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce49e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d379c expref: 42 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.654945:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135793.654949:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.654958:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.654964:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.654995:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135793.655054:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05775450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+41:2375:x1876044512567552:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 220us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135793.655092:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 70 00010000:00010000:0.0:1789135793.655519:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.655528:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135793.655683:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789135793.655826:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4a0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.655843:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135793.655850:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:0.0:1789135793.655853:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135793.655856:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045e00, rc 0) 00000100:00100000:0.0:1789135793.655903:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+41:11689:x1876044512567424:12345-192.168.206.35@tcp:101:dd.0 Request processed in 6206us (6405us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789135793.655912:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 154 00000100:00100000:2.0:1789135793.661992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.662105:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512567808 00000100:00100000:1.0:1789135793.662114:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512567808 00000100:00100000:1.0:1789135793.663985:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 155 00000100:00100000:1.0:1789135793.664008:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+41:11689:x1876044512567808:12345-192.168.206.35@tcp:36:dd.0 00010000:00010000:1.0:1789135793.664271:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.664288:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.664312:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135793.664367:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1789135793.664394:0:7852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f3601c6a reply state 000000006a09b527 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135793.664403:0:7852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135793.664497:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+44:11689:x1876044512567808:12345-192.168.206.35@tcp:36:dd.0 Request processed in 500us (2513us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789135793.664505:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 155 00000020:00080000:1.0:1789135793.664509:0:7852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789135793.671637:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.671652:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.671668:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.671674:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135793.671679:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.671687:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.671702:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:2.0:1789135793.671705:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135793.671710:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135793.671715:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4a20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135793.864177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.864701:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512567936 00000100:00100000:1.0:1789135793.864710:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512567936 00000100:00100000:1.0:1789135793.864770:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 156 00000100:00100000:1.0:1789135793.864781:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+43:11703:x1876044512567936:12345-192.168.206.35@tcp:101:stat.0 00010000:00010000:1.0:1789135793.864802:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135793.864822:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.864891:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.864916:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.864928:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.864954:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.864962:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.864968:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.865058:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.865105:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.865114:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.865146:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.865159:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 44 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135793.865173:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545082752:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135793.865271:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13625300 going to sleep for 11 seconds 00010000:00010000:1.0:1789135793.868778:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135793.871119:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545082752:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135793.871164:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135793.874967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135793.875165:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512568192 00000100:00100000:3.0:1789135793.875173:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512568192 00000100:00100000:3.0:1789135793.875509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:3.0:1789135793.875521:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+45:5618:x1876044512568192:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789135793.875816:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+46:5618:x1876044512568192:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 297us (858us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789135793.875825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:0.0:1789135793.878786:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135793.878954:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512568320 00000100:00100000:3.0:1789135793.878963:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512568320 00010000:00010000:3.0:1789135793.879004:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 46 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135793.879042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:3.0:1789135793.879052:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+46:2376:x1876044512568320:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135793.879088:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135793.879095:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 46 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.879108:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 46 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.879129:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4a12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37aa expref: 46 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.879144:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:3.0:1789135793.879148:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.879169:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.879176:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.879207:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135793.879272:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+45:2376:x1876044512568320:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 221us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135793.879295:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 71 00010000:00010000:1.0:1789135793.880783:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.880797:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135793.880840:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789135793.880844:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135793.880940:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.880955:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.880963:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.880970:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.880976:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.880982:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135793.880985:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.880992:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881017:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135793.881020:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135793.881025:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881031:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881042:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881048:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881054:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881539:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135793.881545:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881553:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881563:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1953c200) 00010000:00010000:1.0:1789135793.881565:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135793.881569:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881574:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881624:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b1 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881639:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b1 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.881645:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135793.881647:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135793.881649:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480c00, rc 0) 00000100:00100000:1.0:1789135793.881822:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+44:11703:x1876044512567936:12345-192.168.206.35@tcp:101:stat.0 Request processed in 17042us (17652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135793.881831:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 156 00000100:00100000:0.0:1789135793.921736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135793.921920:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512568576 00000100:00100000:1.0:1789135793.921929:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512568576 00000100:00100000:1.0:1789135793.921984:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 157 00000100:00100000:1.0:1789135793.921994:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+44:11709:x1876044512568576:12345-192.168.206.35@tcp:36:truncate.0 00010000:00010000:1.0:1789135793.922060:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135793.922106:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b1 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.922124:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135793.922129:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135793.922383:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.922396:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.922413:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135793.922627:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1789135793.922652:0:5837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001fb46a53 reply state 00000000e4cdca08 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135793.922661:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135793.922745:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+46:11709:x1876044512568576:12345-192.168.206.35@tcp:36:truncate.0 Request processed in 752us (1030us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789135793.922753:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 157 00000020:00080000:1.0:1789135793.922758:0:5837:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789135793.925697:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.925713:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.925721:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.925727:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135793.925731:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.925738:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.925753:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:3.0:1789135793.925756:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135793.925760:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.925766:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135794.048357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.048542:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512568704 00000100:00100000:1.0:1789135794.048551:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512568704 00000100:00100000:1.0:1789135794.048699:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 158 00000100:00100000:1.0:1789135794.048710:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+45:11723:x1876044512568704:12345-192.168.206.35@tcp:101:stat.0 00010000:00010000:1.0:1789135794.048732:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135794.048750:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37b8 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048806:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048819:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048830:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048861:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048868:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048955:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049059:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049107:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049115:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135794.049145:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789135794.049157:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135794.049177:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049187:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049194:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049200:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049216:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049222:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135794.049226:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049244:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049257:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135794.049260:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135794.049264:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049270:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4a51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049282:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049288:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049293:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049298:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135794.049301:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049316:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049324:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1953c200) 00010000:00010000:1.0:1789135794.049327:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135794.049330:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049335:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049364:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 47 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049378:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 46 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.049384:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135794.049387:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135794.049389:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481400, rc 0) 00000100:00100000:1.0:1789135794.049442:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+46:11723:x1876044512568704:12345-192.168.206.35@tcp:101:stat.0 Request processed in 734us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.049450:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 158 00000100:00080000:0.0:1789135794.050237:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135794.110614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.110686:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512568960 00000100:00100000:1.0:1789135794.110695:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512568960 00000100:00100000:1.0:1789135794.110822:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 159 00000100:00100000:1.0:1789135794.110833:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+46:11733:x1876044512568960:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135794.110866:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135794.110885:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135794.111002:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789135794.111155:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37bf expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.111170:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:1.0:1789135794.111173:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135794.111180:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37bf expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.111195:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480c00, rc 0) 00000100:00100000:1.0:1789135794.111269:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+47:11733:x1876044512568960:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 439us (663us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789135794.111277:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 159 00000100:00100000:2.0:1789135794.115633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.115851:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512569216 00000100:00100000:0.0:1789135794.115860:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512569216 00000100:00100000:0.0:1789135794.115966:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:0.0:1789135794.115977:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+47:11733:x1876044512569216:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135794.116383:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+48:11733:x1876044512569216:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 407us (757us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789135794.116390:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:2.0:1789135794.177706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.178864:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512569472 00000100:00100000:1.0:1789135794.178874:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512569472 00000100:00100000:1.0:1789135794.178944:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 160 00000100:00100000:1.0:1789135794.178955:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+48:11739:x1876044512569472:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135794.178976:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135794.178995:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37c6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.179107:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.179137:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 49 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.179146:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.179176:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 49 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.179188:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 49 pid: 7852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135794.179202:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545082880:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135794.179307:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc136259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135794.186997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.187112:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512569600 00000100:00100000:0.0:1789135794.187123:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512569600 00010000:00010000:0.0:1789135794.187176:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 50 pid: 7852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135794.187215:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:0.0:1789135794.187225:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+50:2376:x1876044512569600:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135794.187240:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135794.187246:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 50 pid: 7852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.187259:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 50 pid: 7852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.187283:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:0.0:1789135794.187288:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.187298:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.187306:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.187324:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135794.187387:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+50:2376:x1876044512569600:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 163us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135794.187394:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 72 00010000:00010000:1.0:1789135794.187802:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37b8 expref: 49 pid: 7852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135794.187819:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545082880:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135794.187860:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.187869:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.187875:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135794.187902:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789135794.188043:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.188058:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 49 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.188127:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135794.188130:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135794.188133:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481c00, rc 0) 00000100:00100000:1.0:1789135794.188250:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545083392:0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.188265:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545083008:0@lo:400:kworker.0 00000100:00100000:1.0:1789135794.188309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.188310:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.188353:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545083520:0@lo:400:kworker.0 00000100:00100000:1.0:1789135794.188776:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+49:11739:x1876044512569472:12345-192.168.206.35@tcp:101:bash.0 Request processed in 9820us (11076us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789135794.188785:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 160 00000100:00100000:0.0:1789135794.188843:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545083264:0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.190261:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.190392:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545083008 00000100:00100000:3.0:1789135794.190400:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545083008 00000100:00100000:3.0:1789135794.190452:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789135794.190462:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545083008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.190513:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3314:x1876044545083008:12345-0@lo:400:kworker.0 Request processed in 54us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.190520:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789135794.190564:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545083392 00000100:00100000:3.0:1789135794.190568:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545083392 00000100:00100000:3.0:1789135794.191615:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789135794.191626:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545083392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.191685:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545083392:12345-0@lo:400:kworker.0 Request processed in 62us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.191691:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789135794.191733:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545083392:0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.191763:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545083008:0@lo:400:kworker.0 00000100:00100000:1.0:1789135794.191811:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545083136:0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.191819:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545083520 00000100:00100000:3.0:1789135794.191825:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545083520 00000100:00100000:1.0:1789135794.191854:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.191861:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789135794.191872:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545083520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135794.191883:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545083648:0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.191932:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545083520:12345-0@lo:400:kworker.0 Request processed in 63us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.191949:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789135794.192270:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545083520:0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.192292:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545083136 00000100:00100000:3.0:1789135794.192294:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545083136 00000100:00100000:3.0:1789135794.192333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789135794.192340:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545083136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135794.192371:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545083136:12345-0@lo:400:kworker.0 Request processed in 32us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.192377:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1789135794.192406:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135794.192410:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135794.192560:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135794.192596:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545083136:0@lo:400:kworker.0 00000100:00100000:1.0:1789135794.192622:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545083648 00000100:00100000:0.0:1789135794.193026:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135794.193088:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545083264 00000100:00100000:0.0:1789135794.193097:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545083264 00000100:00080000:0.0:1789135794.193113:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135794.193134:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789135794.193140:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545083264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135794.193176:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545083264:12345-0@lo:400:kworker.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135794.193182:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789135794.193208:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545083264:0@lo:400:kworker.0 00000100:00100000:1.0:1789135794.193598:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545083648 00000100:00100000:1.0:1789135794.193632:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789135794.193639:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876044545083648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135794.193683:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876044545083648:12345-0@lo:400:kworker.0 Request processed in 45us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.194744:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789135794.194832:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545083648:0@lo:400:kworker.0 00000100:00100000:0.0:1789135794.198691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135794.198812:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512569856 00000100:00100000:3.0:1789135794.198820:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512569856 00000100:00100000:3.0:1789135794.198873:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 161 00000100:00100000:3.0:1789135794.198882:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+49:11739:x1876044512569856:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:3.0:1789135794.199295:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.199313:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.199324:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135794.199368:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789135794.199388:0:7852:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000019414b1d reply state 000000008745fa81 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135794.199397:0:7852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135794.200241:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+52:11739:x1876044512569856:12345-192.168.206.35@tcp:36:bash.0 Request processed in 1354us (1551us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789135794.200252:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 161 00000020:00080000:3.0:1789135794.200260:0:7852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789135794.204820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.204946:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512569984 00000100:00100000:1.0:1789135794.204956:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512569984 00000100:00100000:1.0:1789135794.205011:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 162 00000100:00100000:1.0:1789135794.205022:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+52:11739:x1876044512569984:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135794.205044:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135794.205095:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37cd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.205168:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.205181:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.205189:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.205195:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.205214:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.205238:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.205251:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 53 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135794.205278:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545083776:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135794.205359:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13625300 going to sleep for 11 seconds 00010000:00010000:2.0:1789135794.205862:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.205871:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.205877:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.205882:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135794.205885:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.205903:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.205917:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:2.0:1789135794.205919:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135794.205922:0:3300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.205986:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.205994:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e200/0x5b09da6ee1ce4a89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135794.207582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.207670:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fda40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545083776:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135794.207692:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135794.208053:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512570112 00000100:00100000:3.0:1789135794.208250:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512570112 00010000:00010000:3.0:1789135794.208290:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 53 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135794.208332:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:3.0:1789135794.208342:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+53:2375:x1876044512570112:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135794.208355:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135794.208362:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 53 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.208375:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 53 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.208395:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4a7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37c6 expref: 53 pid: 5837 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.208410:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:3.0:1789135794.208415:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.208425:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.208432:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.208548:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135794.208604:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+52:2375:x1876044512570112:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 264us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.208618:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 73 00010000:00010000:2.0:1789135794.209663:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.209675:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135794.209717:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789135794.209765:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135794.209786:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.209816:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37cd expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.209833:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37cd expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.209841:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:2.0:1789135794.209844:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135794.209847:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481400, rc 0) 00000100:00100000:2.0:1789135794.209906:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+51:11739:x1876044512569984:12345-192.168.206.35@tcp:101:bash.0 Request processed in 4885us (5095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135794.212203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 162 00000100:00100000:3.0:1789135794.213597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.213686:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512570368 00000100:00100000:2.0:1789135794.213695:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512570368 00000100:00100000:2.0:1789135794.213804:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1789135794.213813:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+51:11739:x1876044512570368:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:2.0:1789135794.214046:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+52:11739:x1876044512570368:12345-192.168.206.35@tcp:35:bash.0 Request processed in 234us (454us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789135794.214055:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1789135794.302368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.302487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512570624 00000100:00100000:0.0:1789135794.302496:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512570624 00000100:00100000:0.0:1789135794.302553:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 163 00000100:00100000:0.0:1789135794.302563:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+52:11749:x1876044512570624:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135794.302585:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135794.302603:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135794.302698:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789135794.302800:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4a9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37d4 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.302814:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:0.0:1789135794.302817:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135794.302822:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37d4 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.302835:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045a00, rc 0) 00000100:00100000:0.0:1789135794.302913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+53:11749:x1876044512570624:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 350us (551us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1789135794.302920:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 163 00000100:00100000:3.0:1789135794.305731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.305823:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512570752 00000100:00100000:1.0:1789135794.305831:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512570752 00000100:00100000:1.0:1789135794.305880:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 164 00000100:00100000:1.0:1789135794.305889:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+53:11749:x1876044512570752:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:1.0:1789135794.305963:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.305978:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.305988:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306001:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306007:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306013:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306164:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306172:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306179:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135794.306212:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306224:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306230:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306236:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306242:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135794.306246:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306253:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306263:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135794.306266:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135794.306270:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306282:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306294:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306300:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306306:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306311:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135794.306313:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306318:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306325:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1953c200) 00010000:00010000:1.0:1789135794.306327:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135794.306330:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306334:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306347:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306352:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306364:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306369:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135794.306372:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306377:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306384:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135794.306386:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135794.306389:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.306394:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4aba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135794.306454:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+53:11749:x1876044512570752:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 566us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.306462:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 164 00000100:00100000:1.0:1789135794.309955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.310108:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512571008 00000100:00100000:0.0:1789135794.310118:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512571008 00000100:00100000:0.0:1789135794.310172:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:0.0:1789135794.310180:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+53:11749:x1876044512571008:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135794.310561:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+54:11749:x1876044512571008:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 381us (615us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789135794.310569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:2.0:1789135794.345512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.345749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512571264 00000100:00100000:1.0:1789135794.345759:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512571264 00000100:00100000:1.0:1789135794.345811:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 165 00000100:00100000:1.0:1789135794.345821:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+54:11752:x1876044512571264:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135794.345844:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135794.345863:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ac1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.345961:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.345976:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.345986:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.345999:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346007:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346013:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346169:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4ad6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346179:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346186:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135794.346195:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789135794.346602:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346610:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346626:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346631:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135794.346635:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346643:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346655:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135794.346658:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135794.346662:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346669:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4ac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346681:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346687:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346693:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346697:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135794.346700:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346716:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346725:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1953c200) 00010000:00010000:1.0:1789135794.346727:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135794.346730:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346735:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4acf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346781:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ac1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37db expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346795:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37db expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.346802:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135794.346805:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135794.346807:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481a00, rc 0) 00000100:00100000:1.0:1789135794.346954:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+56:11752:x1876044512571264:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1133us (1451us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789135794.346963:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 165 00000100:00100000:3.0:1789135794.352880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135794.352931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.353425:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512571520 00000100:00100000:2.0:1789135794.353435:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512571520 00000100:00100000:2.0:1789135794.353615:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:2.0:1789135794.353626:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+56:2376:x1876044512571520:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135794.353642:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135794.353665:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4ad6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37db expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.353682:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:2.0:1789135794.353687:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135794.353750:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+55:2376:x1876044512571520:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 127us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135794.353757:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:0.0:1789135794.354440:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512571392 00000100:00100000:0.0:1789135794.354448:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512571392 00000100:00100000:0.0:1789135794.354492:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 166 00000100:00100000:0.0:1789135794.354501:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+55:11752:x1876044512571392:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1789135794.354566:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354581:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354592:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354615:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354621:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354644:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354650:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135794.354654:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354662:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354671:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:0.0:1789135794.354674:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135794.354678:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.354684:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135794.354746:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+55:11752:x1876044512571392:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 246us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135794.354753:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 166 00000100:00100000:0.0:1789135794.359006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.359138:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512571776 00000100:00100000:2.0:1789135794.359526:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512571776 00000100:00100000:2.0:1789135794.359586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:2.0:1789135794.359596:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+55:11752:x1876044512571776:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:2.0:1789135794.360413:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+56:11752:x1876044512571776:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 813us (1410us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789135794.360423:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:3.0:1789135794.479624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.479742:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512572032 00000100:00100000:0.0:1789135794.479751:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512572032 00000100:00100000:0.0:1789135794.479810:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 167 00000100:00100000:0.0:1789135794.479820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+56:11770:x1876044512572032:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:0.0:1789135794.479841:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135794.479860:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4aeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.480000:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4af2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.480015:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.480027:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135794.480037:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789135794.480176:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4aeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37e2 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.480194:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37e2 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.480203:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:0.0:1789135794.480206:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789135794.480210:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045e00, rc 0) 00000100:00100000:0.0:1789135794.480285:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11770:x1876044512572032:12345-192.168.206.35@tcp:101:cat.0 Request processed in 467us (670us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789135794.480292:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 167 00000100:00100000:0.0:1789135794.515190:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.515329:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512572160 00000100:00100000:1.0:1789135794.515338:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512572160 00000100:00100000:1.0:1789135794.515392:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 168 00000100:00100000:1.0:1789135794.515401:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11771:x1876044512572160:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135794.515437:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135794.515456:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37e9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.515534:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.515548:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.515559:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135794.515611:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789135794.515615:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135794.515634:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.515657:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37e9 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.515673:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37e9 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.515681:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135794.515684:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135794.515686:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481e00, rc 0) 00000100:00100000:1.0:1789135794.515743:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11771:x1876044512572160:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 343us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.515751:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 168 00000100:00100000:1.0:1789135794.529502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.529639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512572544 00000100:00100000:0.0:1789135794.529648:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512572544 00000100:00100000:0.0:1789135794.529703:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:0.0:1789135794.529713:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11771:x1876044512572544:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135794.530044:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11771:x1876044512572544:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 331us (550us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789135794.530053:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:3.0:1789135794.532420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.532516:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512572672 00000100:00100000:1.0:1789135794.532525:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512572672 00000100:00100000:1.0:1789135794.532595:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:1.0:1789135794.532604:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11771:x1876044512572672:12345-192.168.206.35@tcp:103:lfs.0 00010000:00010000:1.0:1789135794.532620:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789135794.532644:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37cd expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.532666:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37e2 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.532678:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce49a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d378e expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.532687:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953cd00) 00010000:00010000:1.0:1789135794.532703:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135794.532764:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+57:11771:x1876044512572672:12345-192.168.206.35@tcp:103:lfs.0 Request processed in 161us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.532773:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:3.0:1789135794.534586:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.540179:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512572800 00000100:00100000:1.0:1789135794.540192:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512572800 00000100:00100000:1.0:1789135794.540263:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 169 00000100:00100000:1.0:1789135794.540274:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+57:11771:x1876044512572800:12345-192.168.206.35@tcp:58:lfs.0 00010000:00010000:1.0:1789135794.540376:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.540393:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.540422:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135794.540614:0:7852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789135794.540702:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+57:11771:x1876044512572800:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 429us (6120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.540710:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 169 00000100:00100000:2.0:1789135794.572928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.573043:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512572928 00000100:00100000:0.0:1789135794.573052:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512572928 00000100:00100000:0.0:1789135794.573126:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 170 00000100:00100000:0.0:1789135794.573135:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+57:11773:x1876044512572928:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135794.573163:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135794.573181:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37f0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573241:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573255:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573266:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573278:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573285:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573292:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573553:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573574:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573581:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135794.573611:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789135794.573615:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135794.573632:0:5836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573643:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573652:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573658:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573664:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573670:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135794.573674:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573681:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573693:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135794.573695:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135794.573707:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573713:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573727:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573733:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573739:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573744:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135794.573746:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573751:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573759:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc062d3800) 00010000:00010000:0.0:1789135794.573762:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135794.573765:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573770:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573802:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573833:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.573841:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:0.0:1789135794.573843:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135794.573845:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045e00, rc 0) 00000100:00100000:0.0:1789135794.573916:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11773:x1876044512572928:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 781us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135794.573923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 170 00000040:00080000:2.0:1789135794.704530:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135794.704540:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135794.704602:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789135794.704608:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135794.704719:0:12074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545083904:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135794.704805:0:12074:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc033c79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135794.711245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.711300:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512573056 00000100:00100000:2.0:1789135794.711309:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512573056 00000100:00100000:2.0:1789135794.711365:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 171 00000100:00100000:2.0:1789135794.711376:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11784:x1876044512573056:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789135794.711405:0:11758:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789135794.711508:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11784:x1876044512573056:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 134us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135794.711516:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 171 00000100:00100000:3.0:1789135794.713766:0:12074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545083904:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789135794.716005:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545084032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135794.716104:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135794.716175:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545084032 00000100:00100000:1.0:1789135794.716182:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545084032 00000100:00100000:1.0:1789135794.716225:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789135794.716249:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545084032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135794.716282:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135794.716326:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545084032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.716334:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789135794.716388:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545084032:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1789135794.716419:0:7850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418288355401ns, next at 419288353506ns, rc = 0 00000100:00100000:2.0:1789135794.723562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.723678:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512573184 00000100:00100000:0.0:1789135794.723688:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512573184 00000100:00100000:0.0:1789135794.723742:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 172 00000100:00100000:0.0:1789135794.723751:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11784:x1876044512573184:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789135794.723827:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.723843:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.723854:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.723868:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.723874:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.723914:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.723941:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.723950:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.723956:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135794.723990:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789135794.723994:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135794.724005:0:5837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724015:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724021:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724027:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724032:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135794.724036:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724044:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724096:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:0.0:1789135794.724099:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135794.724105:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724111:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4b31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724122:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724128:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724133:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724138:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135794.724141:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724147:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724154:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8adc062d3800) 00010000:00010000:0.0:1789135794.724157:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135794.724160:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724165:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4b38 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724192:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724198:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724204:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724209:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135794.724212:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724218:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724238:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:0.0:1789135794.724241:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135794.724245:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.724251:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4b3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135794.724320:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11784:x1876044512573184:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 569us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135794.724328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 172 00000100:00100000:2.0:1789135794.730187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135794.730268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512573440 00000100:00100000:3.0:1789135794.730278:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512573440 00000100:00100000:3.0:1789135794.730338:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 173 00000100:00100000:3.0:1789135794.730348:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11784:x1876044512573440:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135794.730371:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135794.730393:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4b46 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730484:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730499:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730509:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135794.730521:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789135794.730619:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730627:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730633:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730640:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ea00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135794.730644:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730652:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730664:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:3.0:1789135794.730667:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135794.730672:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730678:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730717:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4b46 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f7 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730727:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:3.0:1789135794.730729:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135794.730733:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4b46 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f7 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.730755:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f200, rc 0) 00000100:00100000:3.0:1789135794.730967:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11784:x1876044512573440:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 620us (788us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1789135794.730976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 173 00000100:00100000:2.0:1789135794.737440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135794.737600:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512573568 00000100:00100000:3.0:1789135794.737611:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512573568 00000100:00100000:3.0:1789135794.737675:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 174 00000100:00100000:3.0:1789135794.737686:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11784:x1876044512573568:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135794.737717:0:7852:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135794.738633:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11784:x1876044512573568:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 128us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.738648:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 174 00000100:00100000:2.0:1789135794.749029:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135794.750525:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512573824 00000100:00100000:3.0:1789135794.750538:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512573824 00000100:00100000:3.0:1789135794.750603:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 175 00000100:00100000:3.0:1789135794.750614:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11784:x1876044512573824:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135794.750633:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135794.750636:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789135794.750661:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37e9 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.750676:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135794.750681:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135794.750692:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4b5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d37fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135794.752771:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789135794.756957:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.756980:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.756992:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.757091:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4b5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37fe expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.757110:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37fe expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.757119:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc02cc5d00) 00010000:00010000:3.0:1789135794.757122:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135794.757126:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31ea00, rc 0) 00000100:00100000:3.0:1789135794.757204:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11784:x1876044512573824:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 6591us (8185us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789135794.757213:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 175 00000100:00100000:2.0:1789135794.768774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.768825:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512574080 00000100:00100000:2.0:1789135794.768836:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512574080 00000100:00100000:2.0:1789135794.768920:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 176 00000100:00100000:2.0:1789135794.768931:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11784:x1876044512574080:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789135794.769002:0:11758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135794.769031:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ea00/0x5b09da6ee1ce4b62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37fe expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769093:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc02cc5d00) 00010000:00010000:2.0:1789135794.769105:0:11758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135794.769129:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769144:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769155:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769170:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769178:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769184:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769261:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769268:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769274:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769280:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135794.769285:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769301:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769309:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:2.0:1789135794.769312:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135794.769316:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769322:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4b70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769331:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769336:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769341:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769346:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135794.769348:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769353:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769359:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xce0e8769 (ffff8adc1171a400) 00010000:00010000:2.0:1789135794.769361:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135794.769364:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.769381:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xce0e8769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135794.769464:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11784:x1876044512574080:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 535us (703us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789135794.769472:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 176 00000100:00100000:2.0:1789135794.775366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.775408:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512574208 00000100:00100000:2.0:1789135794.775422:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512574208 00000100:00100000:2.0:1789135794.775491:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 177 00000100:00100000:2.0:1789135794.775504:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11784:x1876044512574208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135794.775534:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135794.775561:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3805 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.775604:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.775622:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.775637:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.775751:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 61 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.775768:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 60 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.775786:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:2.0:1789135794.775789:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135794.775793:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3800, rc 0) 00000100:00100000:2.0:1789135794.776044:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11784:x1876044512574208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 542us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135794.776054:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 177 00000100:00100000:2.0:1789135794.783684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.783726:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512574464 00000100:00100000:2.0:1789135794.783736:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512574464 00000100:00100000:2.0:1789135794.784524:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 178 00000100:00100000:2.0:1789135794.784539:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11784:x1876044512574464:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789135794.784634:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.784652:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.784665:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135794.786014:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789135794.786034:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418357970278ns, next at 419357966293ns, rc = 0 00000004:00010000:2.0:1789135794.787375:0:5838:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003c6e881b reply state 00000000a00d7a25 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135794.787393:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135794.787817:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+62:11784:x1876044512574464:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 3267us (4127us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789135794.787837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 178 00000100:00100000:3.0:1789135794.790250:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:0.0:1789135794.790346:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.790361:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.790382:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.790389:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135794.790394:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.790402:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.790420:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:0.0:1789135794.790423:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135794.790428:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.790436:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4b8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135794.792597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512574592 00000100:00100000:2.0:1789135794.792610:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512574592 00000100:00100000:2.0:1789135794.792676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 179 00000100:00100000:2.0:1789135794.792685:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+61:11784:x1876044512574592:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135794.792707:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135794.792726:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d380c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.792784:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.792799:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.792829:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:2.0:1789135794.792833:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135794.792836:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3200, rc 0) 00000100:00100000:2.0:1789135794.793273:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+62:11784:x1876044512574592:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 588us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135794.793281:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 179 00000001:00080000:1.0:1789135794.793494:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1789135794.793511:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1789135794.800818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135794.800979:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512574720 00000100:00100000:3.0:1789135794.800989:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512574720 00000100:00100000:3.0:1789135794.801095:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:3.0:1789135794.801106:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512574720:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789135794.801434:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512574720:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 328us (630us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789135794.801442:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00080000:0.0:1789135794.801588:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135794.807467:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.807502:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512574976 00000100:00100000:1.0:1789135794.807511:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512574976 00000100:00100000:1.0:1789135794.807678:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:1.0:1789135794.807688:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+62:11784:x1876044512574976:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789135794.807936:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+63:11784:x1876044512574976:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 249us (475us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789135794.807943:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:3.0:1789135794.820169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.821408:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512575232 00000100:00100000:2.0:1789135794.821418:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512575232 00000100:00100000:2.0:1789135794.821469:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 180 00000100:00100000:2.0:1789135794.821478:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+63:11784:x1876044512575232:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135794.821584:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+63:11784:x1876044512575232:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 107us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135794.821592:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 180 00000100:00100000:3.0:1789135794.826925:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.827184:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512575360 00000100:00100000:2.0:1789135794.827194:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512575360 00000100:00100000:2.0:1789135794.827254:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 181 00000100:00100000:2.0:1789135794.827264:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+63:11784:x1876044512575360:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135794.827283:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135794.827301:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4b9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3813 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.827377:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4ba1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.827390:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.827400:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135794.827432:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135794.827449:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.827472:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4b9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3813 expref: 65 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.827485:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3813 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.827502:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:2.0:1789135794.827505:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789135794.827508:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3600, rc 0) 00000100:00100000:2.0:1789135794.827558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+64:11784:x1876044512575360:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 296us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135794.827565:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 181 00000100:00100000:2.0:1789135794.830100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.830308:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512575488 00000100:00100000:1.0:1789135794.830316:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512575488 00000100:00100000:1.0:1789135794.830373:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:1.0:1789135794.830381:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2377:x1876044512575488:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135794.830396:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135794.830413:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d381a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135794.830435:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40bb3, blocks: 0x1 00010000:00010000:1.0:1789135794.830451:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:1.0:1789135794.830455:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135794.830462:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.830478:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.830488:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481400, rc 0) 00000100:00100000:1.0:1789135794.830541:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2377:x1876044512575488:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 161us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.830547:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:3.0:1789135794.834402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.834491:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512575744 00000100:00100000:1.0:1789135794.834509:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512575744 00000100:00100000:1.0:1789135794.834571:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 182 00000100:00100000:1.0:1789135794.834581:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+64:11784:x1876044512575744:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789135794.834678:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+64:11784:x1876044512575744:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 98us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.834686:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 182 00000100:00100000:3.0:1789135794.837530:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.837666:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512575872 00000100:00100000:0.0:1789135794.837676:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512575872 00000100:00100000:0.0:1789135794.837733:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:0.0:1789135794.837743:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+8:11784:x1876044512575872:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135794.837759:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135794.837779:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3821 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.837808:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.837833:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135794.837837:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135794.837844:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.837877:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.837902:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 9 pid: 6682 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135794.837916:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876044545084160:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135794.838006:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc108f6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135794.841689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135794.841864:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512576000 00000100:00100000:3.0:1789135794.841873:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512576000 00010000:00010000:3.0:1789135794.841926:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 10 pid: 6682 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135794.841966:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:3.0:1789135794.841976:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2376:x1876044512576000:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135794.841991:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135794.842012:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 10 pid: 6682 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.842026:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 10 pid: 6682 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.842048:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135794.842053:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135794.842081:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.842111:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.842163:0:8444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135794.842178:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8444:1876044545084288:192.168.206.35@tcp:105: 00000100:00100000:3.0:1789135794.842261:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13e9a6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789135794.842697:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7999c80/0x5b09da6ee1ce4ba8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d381a expref: 10 pid: 6682 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135794.842714:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1876044545084160:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135794.842747:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135794.842758:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045c00, rc 0) 00000100:00100000:0.0:1789135794.842798:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+9:11784:x1876044512575872:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 5056us (5276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135794.842815:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:0.0:1789135794.851824:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f9e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8444:1876044545084288:192.168.206.35@tcp:105: 00010000:00010000:0.0:1789135794.851871:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135794.851936:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512576000:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 9961us (10254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135794.851947:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 74 00000100:00100000:3.0:1789135794.852455:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.853439:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512576128 00000100:00100000:2.0:1789135794.853449:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512576128 00002000:00100000:2.0:1789135794.853501:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8adc3a2f8b40 x1876044512576128/t0(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:225/0 lens 504/0 e 0 to 0 dl 1789135805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135794.853512:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3a2f8b40 with x1876044512576128 ext(0->8) 00002000:00010000:2.0:1789135794.853517:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc3a2f8b40 00000100:00100000:2.0:1789135794.853536:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:2.0:1789135794.853544:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512576128:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789135794.854085:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2376:x1876044512576128:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 Request processed in 518us (1607us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789135794.854095:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00002000:00100000:2.0:1789135794.854102:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8adc3a2f8b40 x1876044512576128/t4294967314(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:225/0 lens 504/448 e 0 to 0 dl 1789135805 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135794.854110:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3a2f8b40 with x1876044512576128 ext(0->8) 00002000:00010000:2.0:1789135794.854113:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc3a2f8b40 00000100:00100000:3.0:1789135794.859756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135794.859859:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512576256 00000100:00100000:0.0:1789135794.859869:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512576256 00000100:00100000:0.0:1789135794.859939:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 183 00000100:00100000:0.0:1789135794.859949:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+64:11784:x1876044512576256:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1789135794.892321:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135794.924366:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+64:11784:x1876044512576256:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 64409us (64611us total) trans 0 rc 0/0 00000001:00080000:2.0:1789135794.924374:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000100:00100000:3.0:1789135794.924379:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 183 00000001:00080000:2.0:1789135794.924424:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1789135794.924435:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1789135794.924469:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1789135794.924486:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789135794.924495:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adc06aeb000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789135794.924499:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc079e7400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adc06aeb600 00000020:00080000:2.0:1789135794.924501:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc079e7600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc078f3400 00000020:00080000:2.0:1789135794.924636:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1789135794.924717:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545084416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789135794.924767:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135794.924832:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545084416 00000100:00100000:1.0:1789135794.924839:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545084416 00000100:00100000:1.0:1789135794.924897:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789135794.924906:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545084416:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1789135794.924953:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00002000:00010000:1.0:1789135794.925025:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789135794.925029:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789135795 00002000:00010000:1.0:1789135794.925032:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789135794.925034:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789135795 -> 1789135795 00002000:00010000:1.0:1789135794.925037:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789135794.925099:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044545084416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (332us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789135794.925106:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:2.0:1789135794.925358:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc41cef480/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789135794.925364:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545084416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789135794.925451:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135794.925461:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545084544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789135794.925492:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.925549:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545084544 00000100:00100000:3.0:1789135794.925554:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545084544 00000100:00100000:3.0:1789135794.925591:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789135794.925598:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545084544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789135794.925615:0:6765:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1789135794.925639:0:6765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa40bb1, atime: 0x6aa40bb1, ctime: 0x6aa40bb1, blocks: 0xb 00010000:00010000:3.0:1789135794.925646:0:6765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.925660:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789135794.925663:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135794.925676:0:6765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.925691:0:6765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.925701:0:6765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.925709:0:6765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.925723:0:6765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789135794.926374:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044545084544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 775us (879us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789135794.926382:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135794.926610:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789135794.926616:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789135794.926635:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8adb0319cf00 x1876044545084544/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789135810 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789135794.926645:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adb0319cf00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789135794.926650:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545084544:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789135794.926707:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135794.926713:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.926723:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135794.926727:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.926746:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.926762:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.926771:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce4bb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.926801:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135794.926803:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135794.926804:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135794.928776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.929643:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512576384 00000100:00100000:1.0:1789135794.929653:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512576384 00000100:00100000:1.0:1789135794.929759:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:1.0:1789135794.929770:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2375:x1876044512576384:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789135794.978326:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1789135794.978346:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1789135794.978515:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512576384:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 48743us (49741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.978526:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:3.0:1789135794.984554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135794.984646:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512576640 00000100:00100000:2.0:1789135794.984656:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512576640 00000100:00100000:2.0:1789135794.984713:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 184 00000100:00100000:2.0:1789135794.984724:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+18:11784:x1876044512576640:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789135794.985025:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135794.985052:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4ba1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3813 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.985847:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:2.0:1789135794.985852:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135794.985880:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.985904:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135794.985914:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135794.986171:0:5838:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000003b0d6d1 reply state 00000000c183fd8e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135794.986181:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135794.986281:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11784:x1876044512576640:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 1557us (1734us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789135794.986289:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 184 00000100:00100000:0.0:1789135794.994102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135794.994217:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512576768 00000100:00100000:1.0:1789135794.994226:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512576768 00000100:00100000:1.0:1789135794.994383:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:1.0:1789135794.994393:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512576768:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789135794.994614:0:6765:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789135794.994617:0:6765:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789135795 -> 1789135794 00002000:00010000:1.0:1789135794.994620:0:6765:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789135793 00002000:00010000:1.0:1789135794.994623:0:6765:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789135795 -> 1789135794 00002000:00010000:1.0:1789135794.994625:0:6765:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789135794.994680:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512576768:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 288us (624us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789135794.994689:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00010000:00010000:3.0:1789135794.996536:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.996549:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.996557:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.996563:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135794.996567:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.996582:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.996597:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:3.0:1789135794.996600:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135794.996605:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.996611:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4bbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.002570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135795.002701:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512577024 00000100:00100000:3.0:1789135795.002709:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512577024 00000100:00100000:3.0:1789135795.002766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 185 00000100:00100000:3.0:1789135795.003020:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+18:11784:x1876044512577024:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789135795.003640:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.003659:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 18 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.003669:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.003704:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 18 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.003718:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 18 pid: 7852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135795.003750:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1876044545084672:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135795.003915:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03e0d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135795.008374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135795.008431:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512577152 00000100:00100000:1.0:1789135795.008440:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512577152 00010000:00010000:1.0:1789135795.008480:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 19 pid: 7852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135795.008520:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:1.0:1789135795.008530:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05774c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+19:2376:x1876044512577152:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135795.008545:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135795.008551:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 19 pid: 7852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.008583:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 19 pid: 7852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.008604:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:1.0:1789135795.008610:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.008620:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.008627:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.008645:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135795.008692:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05774c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+19:2376:x1876044512577152:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 163us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135795.008700:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 75 00010000:00010000:3.0:1789135795.014139:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4b85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3805 expref: 18 pid: 7852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135795.014162:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1876044545084672:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135795.014199:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014210:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014216:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014311:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014318:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014325:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014331:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135795.014335:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014355:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014371:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:3.0:1789135795.014373:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789135795.014378:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.014384:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4bc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135795.014456:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+17:11784:x1876044512577024:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 Request processed in 11681us (11893us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789135795.014465:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 185 00000100:00100000:0.0:1789135795.018627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135795.018967:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512577280 00000100:00100000:1.0:1789135795.018976:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512577280 00000100:00100000:1.0:1789135795.019036:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:1.0:1789135795.019046:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512577280:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789135795.019107:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.019125:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.019166:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135795.019171:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135795.019175:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.019211:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.019226:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 8 pid: 6681 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135795.019241:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34bca940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545084800:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135795.019327:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135795.030300:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.030413:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512577408 00000100:00100000:0.0:1789135795.030422:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512577408 00010000:00010000:0.0:1789135795.030488:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 9 pid: 6681 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.030528:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:0.0:1789135795.030539:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512577408:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135795.030556:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135795.030578:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 9 pid: 6681 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.030594:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 9 pid: 6681 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.030619:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135795.030624:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135795.030629:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.030640:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.030661:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135795.030715:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512577408:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 178us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.030741:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 76 00010000:00010000:2.0:1789135795.030883:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4baf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3821 expref: 8 pid: 6681 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.030906:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34bca940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545084800:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135795.030925:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.030935:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.030942:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.030965:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.030972:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.030980:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.030988:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135795.031000:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.031008:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.031021:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.031028:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4bcb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.031114:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512577280:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 12068us (12495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.031123:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:2.0:1789135795.042199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.045437:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512577664 00000100:00100000:0.0:1789135795.045449:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512577664 00000100:00100000:2.0:1789135795.048532:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 186 00000100:00100000:2.0:1789135795.048551:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+17:11784:x1876044512577664:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789135795.048629:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.048645:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.048655:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.048832:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.048850:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.048858:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.048967:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.048981:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 18 pid: 5837 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.048994:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545084928:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135795.049093:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135795.053480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135795.053526:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512577792 00000100:00100000:2.0:1789135795.053532:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512577792 00000100:00100000:3.0:1789135795.053537:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545084928:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135795.053559:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.053564:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 19 pid: 5837 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.053598:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:2.0:1789135795.053607:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+19:2375:x1876044512577792:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135795.053620:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135795.053626:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 19 pid: 5837 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.053637:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 19 pid: 5837 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.053666:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4b93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d380c expref: 19 pid: 5837 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.053678:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:2.0:1789135795.053683:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.053692:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.053699:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.053717:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135795.053763:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+18:2375:x1876044512577792:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 157us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.053771:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 77 00010000:00010000:3.0:1789135795.055566:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.055579:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135795.056413:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789135795.056576:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789135795.056629:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789135795.056744:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545085056:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789135795.056805:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135795.056845:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135795.058006:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545085056 00000100:00100000:0.0:1789135795.058021:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545085056 00000100:00100000:0.0:1789135795.058084:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135795.058094:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7852:x1876044545085056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135795.058186:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7852:x1876044545085056:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.058192:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135795.058540:0:7852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789135795.058546:0:7852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc41cef480, transno 4294967315 00000100:00100000:2.0:1789135795.058568:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545085056:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789135795.059032:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789135795.059118:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545085184:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789135795.059185:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.059212:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc15569f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135795.059527:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545085184 00000100:00100000:0.0:1789135795.059533:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545085184 00000100:00100000:0.0:1789135795.059563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135795.059571:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7852:x1876044545085184:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135795.060299:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7852:x1876044545085184:12345-0@lo:1000:mdt00_003.0 Request processed in 727us (1112us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789135795.060309:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135795.061370:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545085184:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789135795.061409:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061427:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061435:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061440:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.061445:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061452:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061466:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc1171ad00) 00010000:00010000:2.0:1789135795.061469:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135795.061474:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061480:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4bd9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061509:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061515:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061521:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061526:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.061534:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061540:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061549:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:2.0:1789135795.061551:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135795.061554:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061561:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4b0e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061579:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061593:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061602:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061633:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.061647:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 21 pid: 5836 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.061660:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0315cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545085312:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135795.061744:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1569c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135795.064470:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0315cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545085312:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135795.064496:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.067054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.067159:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512577920 00000100:00100000:0.0:1789135795.067168:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512577920 00010000:00010000:0.0:1789135795.067204:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 22 pid: 5836 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.067245:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:0.0:1789135795.067255:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+22:2376:x1876044512577920:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135795.067269:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135795.067275:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 22 pid: 5836 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.067288:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 22 pid: 5836 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.067320:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045e00/0x5b09da6ee1ce4b2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d37f0 expref: 22 pid: 5836 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.067334:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:0.0:1789135795.067339:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.067348:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.067355:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.067385:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135795.067440:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+21:2376:x1876044512577920:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 186us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.067448:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 78 00010000:00010000:2.0:1789135795.067804:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067813:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067825:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067832:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067838:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067843:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.067847:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067855:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067864:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:2.0:1789135795.067867:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135795.067870:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067904:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4be0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067915:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067922:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067927:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067932:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.067935:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067941:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067948:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1953c200) 00010000:00010000:2.0:1789135795.067950:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135795.067953:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.067958:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3600/0x5b09da6ee1ce4bd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.068301:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+20:11784:x1876044512577664:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 19755us (26107us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789135795.068310:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 186 00000020:00080000:2.0:1789135795.068318:0:7852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789135795.068656:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135795.068661:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135795.069099:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789135795.069106:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135795.077325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135795.077779:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512578176 00000100:00100000:3.0:1789135795.077789:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512578176 00000100:00100000:3.0:1789135795.077852:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:3.0:1789135795.077862:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+20:11784:x1876044512578176:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789135795.078873:0:5839:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789135795.078996:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1789135795.079042:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.079059:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.079105:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.079113:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.079118:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.079124:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.079606:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789135795.079709:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+22:11784:x1876044512578176:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 1846us (2388us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789135795.079718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000020:00080000:0.0:1789135795.079723:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789135795.082674:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135795.082686:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.082697:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135795.082701:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.082711:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.082725:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8adc062d3800) 00010000:00010000:2.0:1789135795.082728:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789135795.082732:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.082738:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4be7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.082755:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135795.082757:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135795.082759:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135795.123004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135795.123056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135795.123115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135795.123148:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512578560 00000100:00100000:1.0:1789135795.123158:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512578560 00000100:00100000:1.0:1789135795.123223:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 177 00000100:00100000:1.0:1789135795.123234:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512578560:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135795.123307:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2377:x1876044512578560:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135795.123315:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 177 00000100:00080000:1.0:1789135795.123347:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135795.124148:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512578432 00000100:00100000:3.0:1789135795.124158:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512578432 00000100:00100000:3.0:1789135795.124225:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:3.0:1789135795.124240:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512578432:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135795.124301:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2377:x1876044512578432:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 68us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.124309:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:3.0:1789135795.124335:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512578304 00000100:00100000:3.0:1789135795.124340:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512578304 00000100:00100000:3.0:1789135795.124370:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 329 00000100:00100000:3.0:1789135795.124379:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512578304:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135795.124406:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512578304:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 30us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.124412:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 329 00000100:00080000:1.0:1789135795.128283:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789135795.349124:0:12893:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135795.349130:0:12893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135795.349153:0:12893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789135795.349157:0:12893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135795.490619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.490820:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512578816 00000100:00100000:0.0:1789135795.490830:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512578816 00000100:00100000:0.0:1789135795.491185:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 187 00000100:00100000:0.0:1789135795.491196:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+22:11794:x1876044512578816:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135795.491218:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135795.491237:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4bee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3828 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.491467:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4bf5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.491494:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.491513:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135795.491525:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1789135795.492609:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4bee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3828 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.492630:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3828 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.492638:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135795.492641:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135795.492644:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045400, rc 0) 00000100:00100000:0.0:1789135795.492711:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11794:x1876044512578816:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1516us (2099us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789135795.492720:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 187 00000100:00100000:0.0:1789135795.497339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135795.497421:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512578944 00000100:00100000:2.0:1789135795.497430:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512578944 00000100:00100000:2.0:1789135795.497616:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 188 00000100:00100000:2.0:1789135795.497627:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11794:x1876044512578944:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:2.0:1789135795.497841:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.497871:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.497882:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.498108:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.498118:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.498126:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498453:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498528:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498546:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135795.498583:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498595:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498600:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498607:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498612:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135795.498617:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498624:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498635:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135795.498638:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135795.498642:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498648:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498657:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498667:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498673:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498678:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135795.498681:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498686:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498763:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1171ad00) 00010000:00010000:3.0:1789135795.498766:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135795.498769:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498774:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498790:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498796:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498801:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498805:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135795.498813:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498819:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498826:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc02cc5800) 00010000:00010000:3.0:1789135795.498829:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135795.498831:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.498837:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135795.498925:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11794:x1876044512578944:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 1298us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.498934:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 188 00000100:00100000:2.0:1789135795.570489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135795.570530:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512579200 00000100:00100000:2.0:1789135795.570538:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512579200 00000100:00100000:2.0:1789135795.570584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 189 00000100:00100000:2.0:1789135795.570592:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11797:x1876044512579200:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135795.570610:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135795.570627:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d382f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.570699:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.570714:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.570731:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.570747:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.570755:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.570761:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571100:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571109:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571116:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135795.571126:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789135795.571213:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571220:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571226:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571232:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.571241:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571250:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571262:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:2.0:1789135795.571265:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135795.571269:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571276:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571285:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571291:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571298:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571303:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.571306:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571313:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571320:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1171a400) 00010000:00010000:2.0:1789135795.571323:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135795.571332:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571338:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3000/0x5b09da6ee1ce4c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571380:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571394:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.571402:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135795.571404:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135795.571406:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2600, rc 0) 00000100:00100000:2.0:1789135795.571462:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+26:11797:x1876044512579200:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 871us (982us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789135795.571470:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 189 00000100:00100000:3.0:1789135795.574058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135795.574109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512579328 00000100:00100000:3.0:1789135795.574117:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512579328 00000100:00100000:3.0:1789135795.574170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 190 00000100:00100000:3.0:1789135795.574240:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+26:11797:x1876044512579328:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:3.0:1789135795.574299:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574314:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574324:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574363:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574370:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574376:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574382:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135795.574386:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574393:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574404:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:3.0:1789135795.574407:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135795.574412:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.574418:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135795.574480:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+26:11797:x1876044512579328:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 301us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.578481:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 190 00000100:00100000:3.0:1789135795.583391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135795.583422:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512579584 00000100:00100000:3.0:1789135795.583430:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512579584 00000100:00100000:3.0:1789135795.583488:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:3.0:1789135795.583498:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+26:11797:x1876044512579584:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1789135795.583693:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+27:11797:x1876044512579584:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 195us (309us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789135795.583701:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:2.0:1789135795.613535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135795.613697:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512579840 00000100:00100000:3.0:1789135795.613707:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512579840 00000100:00100000:3.0:1789135795.613802:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 191 00000100:00100000:3.0:1789135795.613813:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+27:11332:x1876044512579840:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1789135795.613835:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135795.613855:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4c42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3836 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.613952:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.613966:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.613974:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.614002:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.614015:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 28 pid: 5837 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135795.614046:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545085440:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135795.614168:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135795.617469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135795.617622:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512579968 00000100:00100000:1.0:1789135795.617630:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512579968 00010000:00010000:1.0:1789135795.617666:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 29 pid: 5837 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135795.617713:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:1.0:1789135795.617722:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+29:2376:x1876044512579968:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135795.617736:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135795.617743:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 29 pid: 5837 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.617755:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 29 pid: 5837 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.617775:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:1.0:1789135795.617780:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.617789:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.617796:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.617813:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135795.617865:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+29:2376:x1876044512579968:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 144us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135795.617872:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 79 00010000:00010000:0.0:1789135795.618672:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4c2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d382f expref: 28 pid: 5837 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.618825:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545085440:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135795.618851:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.618860:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.618879:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135795.618910:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789135795.619298:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4c42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 29 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.619314:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 28 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.619322:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135795.619324:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135795.619327:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31ec00, rc 0) 00000100:00100000:0.0:1789135795.619380:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+28:11332:x1876044512579840:12345-192.168.206.35@tcp:101:bash.0 Request processed in 5570us (5855us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789135795.619387:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 191 00000100:00100000:3.0:1789135795.622103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135795.622218:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512580224 00000100:00100000:2.0:1789135795.622228:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512580224 00000100:00100000:2.0:1789135795.622280:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 192 00000100:00100000:2.0:1789135795.622290:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+28:11332:x1876044512580224:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:2.0:1789135795.622648:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.622664:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.622674:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135795.622750:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789135795.622777:0:11758:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c9286fe5 reply state 0000000027bdc96e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.622786:0:11758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789135795.622832:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789135795.622941:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11332:x1876044512580224:12345-192.168.206.35@tcp:36:bash.0 Request processed in 652us (878us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789135795.622949:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 192 00000020:00080000:2.0:1789135795.622953:0:11758:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789135795.625266:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.625286:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.625292:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.625298:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.625302:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.625325:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.625345:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135795.625349:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135795.625354:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.625360:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4c57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135795.626460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.626741:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512580352 00000100:00100000:0.0:1789135795.626750:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512580352 00000100:00100000:0.0:1789135795.626802:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 193 00000100:00100000:0.0:1789135795.626811:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+31:11332:x1876044512580352:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1789135795.626834:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135795.626852:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4c5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d383d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.626915:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4c5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d383d expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.626928:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4c5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d383d expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.626945:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135795.626948:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135795.626952:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045000, rc 0) 00000100:00100000:0.0:1789135795.627019:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11332:x1876044512580352:12345-192.168.206.35@tcp:101:bash.0 Request processed in 209us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.627027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 193 00000100:00100000:1.0:1789135795.630094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.630125:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512580480 00000100:00100000:0.0:1789135795.630142:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512580480 00000100:00100000:0.0:1789135795.630207:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:0.0:1789135795.630218:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:11332:x1876044512580480:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1789135795.630236:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135795.630257:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3844 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135795.630284:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa40bb2, atime: 0x6aa40bb1, ctime: 0x6aa40bb2, blocks: 0xb 00010000:00010000:0.0:1789135795.630305:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1789135795.630310:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135795.630324:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.630342:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.630355:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045e00, rc 0) 00000100:00100000:0.0:1789135795.630419:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:11332:x1876044512580480:12345-192.168.206.35@tcp:101:bash.0 Request processed in 203us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.630426:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:2.0:1789135795.632854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135795.632968:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512580608 00000100:00100000:1.0:1789135795.632976:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512580608 00002000:00010000:1.0:1789135795.633011:0:6686:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1789135795.633015:0:6686:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adb0315d2c0 with x1876044512580608 ext(0->18446744073709551615) 00002000:00010000:1.0:1789135795.633026:0:6686:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adb0315d2c0. 00000100:00100000:1.0:1789135795.633056:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:1.0:1789135795.633239:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512580608:12345-192.168.206.35@tcp:10:bash.0 00002000:00010000:1.0:1789135795.633470:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789135795.633473:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789135794 -> 1789135795 00002000:00010000:1.0:1789135795.633475:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789135793 -> 1789135793 00002000:00010000:1.0:1789135795.633478:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789135794 -> 1789135795 00002000:00010000:1.0:1789135795.633480:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789135795.633557:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2375:x1876044512580608:12345-192.168.206.35@tcp:10:bash.0 Request processed in 493us (709us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789135795.633565:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00002000:00010000:1.0:1789135795.633568:0:6686:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1789135795.633571:0:6686:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adb0315d2c0 with x1876044512580608 ext(0->18446744073709551615) 00002000:00010000:1.0:1789135795.633575:0:6686:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adb0315d2c0. 00000100:00100000:3.0:1789135795.708361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.708485:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512580736 00000100:00100000:0.0:1789135795.708494:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512580736 00000100:00100000:0.0:1789135795.708564:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 194 00000100:00100000:0.0:1789135795.708573:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11812:x1876044512580736:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:0.0:1789135795.708640:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.708656:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.708666:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.708682:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.708688:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.708707:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709251:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709261:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709269:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135795.709306:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709317:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709329:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709336:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709342:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.709347:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709354:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709366:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135795.709368:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135795.709373:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709379:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4c6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709390:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709396:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709402:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709407:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.709416:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709422:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709430:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc062d3200) 00010000:00010000:0.0:1789135795.709432:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135795.709435:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709441:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4c73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709455:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709472:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709479:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709483:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.709485:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709491:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709499:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135795.709501:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135795.709511:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.709516:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4c7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.709585:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11812:x1876044512580736:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 1012us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.709593:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 194 00000100:00100000:3.0:1789135795.724399:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545085568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135795.724481:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135795.725117:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545085568 00000100:00100000:1.0:1789135795.725125:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545085568 00000100:00100000:1.0:1789135795.725244:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789135795.725254:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876044545085568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135795.725279:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789135795.725339:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876044545085568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135795.725362:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789135795.725537:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545085568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135795.746763:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135795.746840:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512580992 00000100:00100000:2.0:1789135795.746850:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512580992 00000100:00100000:2.0:1789135795.746922:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 195 00000100:00100000:2.0:1789135795.746932:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11815:x1876044512580992:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135795.746954:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135795.746976:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d384b expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747048:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747095:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747106:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747121:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747154:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747162:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747496:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4c96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747505:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747512:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135795.747522:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789135795.747616:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747623:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747629:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747635:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.747639:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747647:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747667:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:2.0:1789135795.747670:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135795.747676:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747682:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4c88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747696:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747702:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747708:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747713:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.747716:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747722:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747729:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1171a400) 00010000:00010000:2.0:1789135795.747732:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135795.747735:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747740:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4c8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747794:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2400/0x5b09da6ee1ce4c81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d384b expref: 35 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747807:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d384b expref: 34 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.747815:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135795.747817:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789135795.747819:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3200, rc 0) 00000100:00100000:2.0:1789135795.747897:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+34:11815:x1876044512580992:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 966us (1142us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789135795.747906:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 195 00000100:00100000:2.0:1789135795.752632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.752790:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512581120 00000100:00100000:0.0:1789135795.752866:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512581120 00000100:00100000:0.0:1789135795.752985:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 196 00000100:00100000:0.0:1789135795.752996:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+34:11815:x1876044512581120:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:0.0:1789135795.753104:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.753120:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 34 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.753129:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.753173:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 34 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.753187:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 34 pid: 7852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.753200:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1876044545085696:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135795.753293:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05334a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135795.755751:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1876044545085696:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135795.755777:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.756781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135795.757035:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512581376 00000100:00100000:3.0:1789135795.757044:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512581376 00000100:00100000:3.0:1789135795.757127:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:3.0:1789135795.757628:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+35:5618:x1876044512581376:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789135795.758553:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+36:5618:x1876044512581376:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 1414us (1773us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789135795.758562:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:3.0:1789135795.760624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135795.760775:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512581504 00000100:00100000:1.0:1789135795.760784:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512581504 00010000:00010000:1.0:1789135795.760832:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 36 pid: 7852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135795.760873:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:1.0:1789135795.760894:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+36:2376:x1876044512581504:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135795.760911:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135795.760917:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 36 pid: 7852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.760930:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 36 pid: 7852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.760952:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4c49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3836 expref: 36 pid: 7852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.760969:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:1.0:1789135795.760975:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.760985:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.761006:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135795.761175:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135795.761226:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+35:2376:x1876044512581504:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 344us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135795.761233:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 80 00010000:00010000:0.0:1789135795.764499:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.764517:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.764559:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.764566:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.764574:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.764580:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.764585:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.764592:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.764609:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135795.764612:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135795.764618:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.764625:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.764739:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+34:11815:x1876044512581120:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 11729us (12102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.764762:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 196 00000100:00100000:0.0:1789135795.769462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135795.769621:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512581760 00000100:00100000:3.0:1789135795.769630:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512581760 00000100:00100000:3.0:1789135795.769722:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:3.0:1789135795.769733:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+34:11815:x1876044512581760:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:3.0:1789135795.770090:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+35:11815:x1876044512581760:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 359us (635us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789135795.770111:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:1.0:1789135795.879407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.879670:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512582016 00000100:00100000:0.0:1789135795.879680:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512582016 00000100:00100000:0.0:1789135795.879741:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 197 00000100:00100000:0.0:1789135795.879751:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+35:11826:x1876044512582016:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:0.0:1789135795.879775:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135795.879805:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4cab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3852 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.879894:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.879910:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.879922:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.879937:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.879943:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.880208:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.881737:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.881764:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.881774:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135795.881786:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789135795.882655:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882665:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882673:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882679:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.882683:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882690:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882703:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135795.882706:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135795.882711:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882717:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882731:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882744:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882750:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882754:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.882757:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882763:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882771:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc062d3200) 00010000:00010000:0.0:1789135795.882774:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135795.882777:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.882783:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.883689:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4cab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3852 expref: 38 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.883709:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3852 expref: 37 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.883717:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135795.883719:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135795.883731:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031600, rc 0) 00000100:00100000:0.0:1789135795.883811:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+37:11826:x1876044512582016:12345-192.168.206.35@tcp:101:cat.0 Request processed in 4060us (4412us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789135795.883821:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 197 00000100:00100000:1.0:1789135795.893284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.893414:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512582272 00000100:00100000:0.0:1789135795.893425:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512582272 00000100:00100000:0.0:1789135795.893481:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 54 00000100:00100000:0.0:1789135795.893492:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+37:11826:x1876044512582272:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:0.0:1789135795.893712:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+38:11826:x1876044512582272:12345-192.168.206.35@tcp:35:cat.0 Request processed in 222us (437us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789135795.893720:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 54 00010000:00010000:1.0:1789135795.917557:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135795.921639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135795.921741:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512582528 00000100:00100000:2.0:1789135795.921751:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512582528 00000100:00100000:2.0:1789135795.921810:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 198 00000100:00100000:2.0:1789135795.921829:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+38:11827:x1876044512582528:12345-192.168.206.35@tcp:36:rm.0 00010000:00010000:2.0:1789135795.921900:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789135795.921928:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3852 expref: 38 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.921960:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4c96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d384b expref: 37 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.921975:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4c5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d383d expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.921999:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135795.922010:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135795.922350:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.922366:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.922376:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.922392:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.922400:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.922406:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.922688:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.922697:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.922705:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135795.927758:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789135795.927772:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 419499708200ns, next at 420499704641ns, rc = 0 00010000:00010000:2.0:1789135795.928295:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928312:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928323:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928331:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928338:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928344:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928493:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135795.928519:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928525:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928530:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928536:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.928540:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928547:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928567:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171af00) 00010000:00010000:2.0:1789135795.928570:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789135795.928574:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928581:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4cdc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928600:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928605:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928611:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928615:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135795.928618:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928624:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.928631:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:2.0:1789135795.929208:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135795.929214:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.929222:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2a00/0x5b09da6ee1ce4cce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135795.929247:0:5837:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bae67a19 reply state 00000000381f38ec transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.929255:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135795.929348:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+37:11827:x1876044512582528:12345-192.168.206.35@tcp:36:rm.0 Request processed in 7527us (7713us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789135795.929358:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 198 00010000:00010000:3.0:1789135795.934418:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135795.935334:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.935345:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135795.935349:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.935359:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.935375:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8adc1171af00) 00010000:00010000:3.0:1789135795.935379:0:6695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789135795.935383:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.935390:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3800/0x5b09da6ee1ce4ce3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.935412:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135795.935414:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135795.935416:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135795.936749:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.936763:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.936770:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.936792:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135795.936796:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.936803:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.936816:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1171a400) 00010000:00010000:3.0:1789135795.936819:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135795.936833:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.936840:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4cd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135795.975506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.975592:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512582784 00000100:00100000:0.0:1789135795.975602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512582784 00000100:00100000:0.0:1789135795.975667:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 199 00000100:00100000:0.0:1789135795.975678:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+36:11833:x1876044512582784:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1789135795.975702:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135795.975722:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4cea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3859 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.975852:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.975866:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.975876:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.975899:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.975923:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.975931:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135795.976478:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789135795.976629:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976638:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976647:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976677:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976684:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976691:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976698:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.976703:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976710:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976732:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135795.976734:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135795.976739:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976746:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4cf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135795.976758:0:5836:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000014d92fe9 reply state 0000000088de5a56 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.976766:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789135795.976793:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4cea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976806:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.976813:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135795.976815:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135795.976818:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031600, rc 0) 00000100:00100000:0.0:1789135795.976874:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+39:11833:x1876044512582784:12345-192.168.206.35@tcp:101:bash.0 Request processed in 1197us (1377us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789135795.976892:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 199 00010000:00010000:0.0:1789135795.982253:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.982271:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135795.982294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:0.0:1789135795.982302:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.982310:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135795.982315:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.982331:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.982346:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc062d3200) 00010000:00010000:0.0:1789135795.982350:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135795.982355:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.982362:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4cf8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135795.982370:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512582912 00000100:00100000:3.0:1789135795.982379:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512582912 00000100:00100000:3.0:1789135795.982437:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:3.0:1789135795.982448:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2378:x1876044512582912:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:3.0:1789135795.982471:0:6765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135795.982489:0:6765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3860 expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135795.982511:0:6765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135795.982528:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1789135795.982532:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135795.982540:0:6765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 6 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.982569:0:6765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 6 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135795.982580:0:6765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f400, rc 0) 00000100:00100000:3.0:1789135795.982636:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2378:x1876044512582912:12345-192.168.206.35@tcp:101:bash.0 Request processed in 190us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.982643:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:1.0:1789135795.985395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135795.985728:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512583040 00000100:00100000:2.0:1789135795.985737:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512583040 00000100:00100000:2.0:1789135795.985809:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:2.0:1789135795.985819:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:11833:x1876044512583040:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1789135795.985840:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135795.985857:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3867 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.985902:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 7 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.985911:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135795.985915:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135795.985921:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.985960:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 7 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.986002:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 7 pid: 6765 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135795.986016:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0315d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876044545085824:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135795.986137:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11ee7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135795.988386:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0315d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876044545085824:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135795.988438:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.988470:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2a00, rc 0) 00000100:00100000:2.0:1789135795.988522:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:11833:x1876044512583040:12345-192.168.206.35@tcp:101:bash.0 Request processed in 2704us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.988530:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:1.0:1789135795.991555:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.991651:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512583168 00000100:00100000:0.0:1789135795.991660:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512583168 00010000:00010000:0.0:1789135795.991708:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 7 pid: 6765 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.991753:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:0.0:1789135795.991769:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512583168:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135795.991786:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135795.991813:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 7 pid: 6765 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.991851:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 7 pid: 6765 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.991879:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ce761d/0x5b09da6ee1ce4d0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3860 expref: 7 pid: 6765 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.991907:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135795.991911:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135795.991919:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.991935:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135795.991988:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135795.992002:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ed680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876044545085952:192.168.206.35@tcp:105: 00000100:00100000:0.0:1789135795.992122:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05334780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135795.994469:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ed680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876044545085952:192.168.206.35@tcp:105: 00010000:00010000:0.0:1789135795.994490:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135795.994537:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2376:x1876044512583168:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 2775us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.994548:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:2.0:1789135795.995027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135795.995248:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512583424 00000100:00100000:0.0:1789135795.995255:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512583424 00000100:00100000:0.0:1789135795.995299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:0.0:1789135795.995308:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+38:11833:x1876044512583424:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:0.0:1789135795.995609:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+39:11833:x1876044512583424:12345-192.168.206.35@tcp:35:bash.0 Request processed in 300us (582us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789135795.995617:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 55 00000100:00100000:1.0:1789135796.136098:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135796.136192:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512583552 00000100:00100000:0.0:1789135796.136201:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512583552 00000100:00100000:0.0:1789135796.136261:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 200 00000100:00100000:0.0:1789135796.136270:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+39:11849:x1876044512583552:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135796.136289:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135796.136305:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d386e expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.136356:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.136368:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.136378:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135796.136425:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1789135796.136428:0:7852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135796.136444:0:7852:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.136473:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d386e expref: 41 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.136507:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d386e expref: 40 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.136515:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135796.136517:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135796.136520:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031400, rc 0) 00000100:00100000:0.0:1789135796.136569:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+40:11849:x1876044512583552:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 300us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135796.136576:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 200 00000100:00080000:1.0:1789135796.136628:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135796.139150:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135796.139245:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512583808 00000100:00100000:2.0:1789135796.139253:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512583808 00000100:00100000:2.0:1789135796.139298:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 201 00000100:00100000:2.0:1789135796.139307:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+40:11849:x1876044512583808:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:2.0:1789135796.139325:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135796.139342:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4d29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3875 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.139429:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4d30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.139472:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.139482:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135796.139494:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789135796.139602:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2000/0x5b09da6ee1ce4d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3875 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.139617:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3875 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.139624:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135796.139627:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135796.139630:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3200, rc 0) 00000100:00100000:2.0:1789135796.139682:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+42:11849:x1876044512583808:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 376us (538us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789135796.139689:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 201 00000100:00100000:2.0:1789135796.143104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.143281:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512584064 00000100:00100000:1.0:1789135796.143289:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512584064 00000100:00100000:1.0:1789135796.143351:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 202 00000100:00100000:1.0:1789135796.143361:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+42:11849:x1876044512584064:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135796.143384:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135796.143403:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d387c expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.143491:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4d45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.143518:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.143530:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135796.143541:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789135796.143643:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d387c expref: 45 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.143660:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4d45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d387c expref: 44 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.143667:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:1.0:1789135796.143669:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789135796.143672:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480e00, rc 0) 00000100:00100000:1.0:1789135796.153305:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+44:11849:x1876044512584064:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 9931us (10193us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789135796.153321:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 202 00000100:00100000:2.0:1789135796.160401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135796.160473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.160616:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512584320 00000100:00100000:1.0:1789135796.160629:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512584320 00000100:00100000:1.0:1789135796.160688:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:1.0:1789135796.160698:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+6:2375:x1876044512584320:12345-192.168.206.35@tcp:1:lfs.0 00010000:00010000:1.0:1789135796.160752:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.160772:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.160797:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135796.160804:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135796.160809:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.160852:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.160865:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 6 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.160895:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876044545086080:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135796.160994:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135796.164548:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512584192 00000100:00100000:0.0:1789135796.164560:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512584192 00000100:00100000:0.0:1789135796.164623:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:0.0:1789135796.164633:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05777050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+44:2377:x1876044512584192:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135796.164647:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135796.164670:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4d30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3875 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.164687:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135796.164692:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135796.164770:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05777050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+43:2377:x1876044512584192:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 137us (4376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135796.164778:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1789135796.165673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135796.165764:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512584448 00000100:00100000:3.0:1789135796.165770:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512584448 00002000:00100000:3.0:1789135796.165811:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8adb0315e1c0 x1876044512584448/t0(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:227/0 lens 504/0 e 0 to 0 dl 1789135807 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789135796.165832:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adb0315e1c0 with x1876044512584448 ext(0->8) 00010000:00010000:3.0:1789135796.165841:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 7 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.165856:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 7 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135796.165864:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adb0315e1c0 00000100:00100000:3.0:1789135796.165899:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1789135796.165908:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512584448:12345-192.168.206.35@tcp:4:lfs.0 00000100:00100000:3.0:1789135796.166342:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2376:x1876044512584448:12345-192.168.206.35@tcp:4:lfs.0 Request processed in 434us (670us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789135796.166349:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00002000:00100000:3.0:1789135796.166363:0:6687:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8adb0315e1c0 x1876044512584448/t4294967308(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:227/0 lens 504/448 e 0 to 0 dl 1789135807 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789135796.166371:0:6687:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adb0315e1c0 with x1876044512584448 ext(0->8) 00010000:00010000:3.0:1789135796.166377:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 9 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.166388:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 9 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135796.166394:0:6687:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adb0315e1c0 00000100:00100000:0.0:1789135796.167794:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876044545086080:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135796.167829:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135796.173436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135796.174253:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512584576 00000100:00100000:3.0:1789135796.174263:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512584576 00010000:00010000:3.0:1789135796.174307:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 9 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135796.174353:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:3.0:1789135796.174364:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2377:x1876044512584576:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135796.174379:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789135796.174397:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789135796.174400:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789135796 00002000:00010000:3.0:1789135796.174402:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789135796 00002000:00010000:3.0:1789135796.174405:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789135796 00010000:00010000:3.0:1789135796.174411:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 9 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.174426:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 9 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.174465:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4d14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3867 expref: 9 pid: 6682 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.174480:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135796.174485:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135796.174490:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.174500:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.174534:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135796.174764:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.174776:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.174799:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.174808:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.174829:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.174837:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135796.174841:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.174850:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.174863:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.174903:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be62fd1a/0x5b09da6ee1ce4d53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135796.174983:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2377:x1876044512584576:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 620us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135796.174992:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:0.0:1789135796.175654:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512584320:12345-192.168.206.35@tcp:1:lfs.0 Request processed in 14954us (15176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135796.175663:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:2.0:1789135796.178639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135796.179119:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512584832 00000100:00100000:3.0:1789135796.179128:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512584832 00000100:00100000:3.0:1789135796.179407:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 56 00000100:00100000:3.0:1789135796.179417:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+43:11849:x1876044512584832:12345-192.168.206.35@tcp:35:lfs.0 00000004:00010000:3.0:1789135796.179475:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4d45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d387c expref: 43 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135796.179895:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1789135796.179949:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789135796.180574:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1789135796.180623:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.180645:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.180653:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.180685:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.180699:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 47 pid: 5836 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135796.180713:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1876044545086208:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135796.181112:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135796.192385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135796.192486:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1876044545086208:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135796.192513:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135796.192584:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512584960 00000100:00100000:0.0:1789135796.192590:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512584960 00010000:00010000:0.0:1789135796.192620:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 48 pid: 5836 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135796.192654:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:0.0:1789135796.192661:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+48:2375:x1876044512584960:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135796.192674:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135796.192679:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 48 pid: 5836 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.192690:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 48 pid: 5836 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.192709:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4cff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3859 expref: 48 pid: 5836 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.192723:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135796.192728:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.192748:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.192756:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.192780:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135796.192837:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+47:2375:x1876044512584960:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 175us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135796.192845:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 83 00010000:00010000:3.0:1789135796.193099:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.193107:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135796.193212:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789135796.193393:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1789135796.193490:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1876044545086336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789135796.193541:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135796.193619:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc057726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135796.198058:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545086336 00000100:00100000:1.0:1789135796.198084:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545086336 00000100:00100000:1.0:1789135796.198156:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789135796.198166:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1876044545086336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789135796.198290:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1876044545086336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 126us (4748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135796.198298:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135796.198617:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1876044545086336:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1789135796.199321:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789135796.199525:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789135796.199607:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0315da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1876044545086464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789135796.199657:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135796.199679:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135796.199822:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545086464 00000100:00100000:1.0:1789135796.199828:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545086464 00000100:00100000:1.0:1789135796.199857:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789135796.199864:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1876044545086464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789135796.200034:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1876044545086464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (376us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789135796.200049:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135796.200702:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0315da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1876044545086464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789135796.200760:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1789135796.200799:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.200809:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.200816:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.200822:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135796.200826:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.200833:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.200862:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135796.200865:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789135796.200870:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.200876:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4d5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135796.201048:0:5839:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789135796.202433:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789135796.202446:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419774382545ns, next at 420774380505ns, rc = 0 00000001:00080000:2.0:1789135796.202454:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789135796.202511:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135796.202515:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789135796.202523:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4d45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d387c expref: 51 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135796.202634:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+50:11849:x1876044512584832:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 23217us (24001us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789135796.202643:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 56 00000020:00080000:2.0:1789135796.202648:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789135796.207756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135796.211916:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512585088 00000100:00100000:3.0:1789135796.211930:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512585088 00000100:00100000:3.0:1789135796.212005:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 203 00000100:00100000:3.0:1789135796.212015:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+50:11849:x1876044512585088:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135796.212036:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135796.212056:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4d61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3883 expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.212124:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4d61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3883 expref: 51 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.212137:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4d61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3883 expref: 51 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135796.212154:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:3.0:1789135796.212157:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135796.212160:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e400, rc 0) 00000100:00100000:3.0:1789135796.212215:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+51:11849:x1876044512585088:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 201us (4466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135796.212222:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 203 00000100:00100000:3.0:1789135796.224702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.224863:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512585344 00000100:00100000:1.0:1789135796.224873:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512585344 00000100:00100000:1.0:1789135796.224935:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:1.0:1789135796.224945:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+51:11849:x1876044512585344:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1789135796.225215:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+52:11849:x1876044512585344:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 270us (522us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789135796.225223:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 57 00000100:00100000:1.0:1789135796.380439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135796.380555:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512585472 00000100:00100000:0.0:1789135796.380564:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512585472 00000100:00100000:0.0:1789135796.380621:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 204 00000100:00100000:0.0:1789135796.380631:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+52:11859:x1876044512585472:12345-192.168.206.35@tcp:34:lfs.0 00010000:00010000:0.0:1789135796.380699:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380714:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380742:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380757:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380764:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380788:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380901:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380911:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380918:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135796.380954:0:5836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380966:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380972:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380979:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380984:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135796.380988:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.380995:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381007:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135796.381016:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135796.381021:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381027:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381042:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381048:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381053:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381057:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135796.381059:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381119:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381127:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc062d3200) 00010000:00010000:0.0:1789135796.381130:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135796.381133:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381139:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381154:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381165:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381171:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381176:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135796.381180:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381186:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381194:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:0.0:1789135796.381198:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135796.381201:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.381206:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4d76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135796.381292:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+52:11859:x1876044512585472:12345-192.168.206.35@tcp:34:lfs.0 Request processed in 661us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135796.381300:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 204 00000100:00100000:3.0:1789135796.436360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.436511:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512585728 00000100:00100000:1.0:1789135796.436520:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512585728 00000100:00100000:1.0:1789135796.436580:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 205 00000100:00100000:1.0:1789135796.436590:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+52:11862:x1876044512585728:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135796.436609:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135796.436629:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4d7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d388a expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436696:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436710:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436735:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436751:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436773:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436781:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436921:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436930:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.436938:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135796.437146:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789135796.437402:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437409:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437415:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437421:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135796.437425:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437432:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437454:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135796.437657:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135796.437663:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437669:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4d84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437683:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437688:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437694:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437699:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135796.437701:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437706:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.437714:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135796.437716:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135796.438029:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.438037:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4d8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.438136:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4d7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 55 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.438152:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 54 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.438159:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135796.438162:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135796.438164:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481400, rc 0) 00000100:00100000:1.0:1789135796.438400:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+54:11862:x1876044512585728:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1809us (2048us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789135796.438408:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 205 00000100:00100000:2.0:1789135796.443351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.446671:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512585856 00000100:00100000:1.0:1789135796.446685:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512585856 00000100:00100000:1.0:1789135796.447189:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 206 00000100:00100000:1.0:1789135796.447201:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+54:11862:x1876044512585856:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:1.0:1789135796.447416:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447431:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447441:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447476:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447499:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447505:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447511:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135796.447516:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447523:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447536:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135796.447538:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135796.447543:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.447549:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4da0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.447634:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+54:11862:x1876044512585856:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 436us (4291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135796.447642:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 206 00000100:00100000:2.0:1789135796.456048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.457744:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512586112 00000100:00100000:1.0:1789135796.457757:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512586112 00000100:00100000:1.0:1789135796.457832:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:1.0:1789135796.457850:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+54:11862:x1876044512586112:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1789135796.459350:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+55:11862:x1876044512586112:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 297us (2098us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789135796.459376:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 58 00000100:00100000:3.0:1789135796.552150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135796.553220:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512586368 00000100:00100000:2.0:1789135796.553234:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512586368 00000100:00100000:2.0:1789135796.553296:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 207 00000100:00100000:2.0:1789135796.553305:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+55:11872:x1876044512586368:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:2.0:1789135796.553326:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135796.553329:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789135796.553352:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d386e expref: 55 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.553371:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:2.0:1789135796.553376:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135796.553387:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4da7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3891 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.553739:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.553754:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 55 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.553763:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.553797:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 55 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.553812:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 55 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135796.553825:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0315cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545086592:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135796.554647:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135796.560693:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0315cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1876044545086592:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135796.560722:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135796.561502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.562299:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512586496 00000100:00100000:1.0:1789135796.562307:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512586496 00010000:00010000:1.0:1789135796.562344:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 56 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.562454:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:1.0:1789135796.562474:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+56:2375:x1876044512586496:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135796.562488:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135796.562495:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 56 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.562507:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 56 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.562529:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d388a expref: 56 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.562544:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135796.562548:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.562557:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.562565:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.562610:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135796.562665:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+55:2375:x1876044512586496:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 202us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135796.562673:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 84 00010000:00010000:2.0:1789135796.562743:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.562751:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135796.562770:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789135796.562956:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3e00/0x5b09da6ee1ce4da7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.562973:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.562981:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:2.0:1789135796.562984:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135796.562986:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2600, rc 0) 00000100:00100000:2.0:1789135796.563014:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+55:11872:x1876044512586368:12345-192.168.206.35@tcp:101:bash.0 Request processed in 9710us (10874us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789135796.563021:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 207 00000100:00100000:3.0:1789135796.569122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.569512:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512586752 00000100:00100000:1.0:1789135796.569521:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512586752 00000100:00100000:1.0:1789135796.569577:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 208 00000100:00100000:1.0:1789135796.569586:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+55:11872:x1876044512586752:12345-192.168.206.35@tcp:36:bash.0 00010000:00010000:1.0:1789135796.569847:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.569864:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.569875:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135796.569934:0:11758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789135796.569974:0:11758:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e3206725 reply state 0000000073d63ca7 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.569983:0:11758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135796.570100:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11872:x1876044512586752:12345-192.168.206.35@tcp:36:bash.0 Request processed in 514us (985us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789135796.570109:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 208 00000020:00080000:1.0:1789135796.570113:0:11758:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789135796.573843:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:2.0:1789135796.573871:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.573895:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.573903:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.573909:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135796.573913:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.573921:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.573936:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:2.0:1789135796.573939:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135796.573966:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.573972:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4dbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.574059:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512586880 00000100:00100000:1.0:1789135796.574103:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512586880 00000100:00100000:1.0:1789135796.574148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 209 00000100:00100000:1.0:1789135796.574165:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+57:11872:x1876044512586880:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:1.0:1789135796.574186:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135796.574202:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4dc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3898 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.574272:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.574284:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.574293:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.574323:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.574336:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 58 pid: 5838 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.574348:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545086720:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135796.574421:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135796.578102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135796.578226:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512587008 00000100:00100000:0.0:1789135796.578235:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512587008 00010000:00010000:0.0:1789135796.578273:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 59 pid: 5838 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135796.578313:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:0.0:1789135796.578336:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+59:2375:x1876044512587008:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135796.578351:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135796.578358:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 59 pid: 5838 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.578370:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 59 pid: 5838 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.578390:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:0.0:1789135796.578399:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.578409:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.578417:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.578435:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135796.578452:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2600/0x5b09da6ee1ce4dae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3891 expref: 59 pid: 5838 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.578479:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545086720:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135796.578483:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+58:2375:x1876044512587008:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 150us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135796.578490:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 85 00010000:00010000:1.0:1789135796.578499:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.578528:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.578534:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135796.578580:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789135796.578585:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135796.578605:0:5837:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.578635:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4dc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.578650:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.578658:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135796.578662:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135796.578665:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481e00, rc 0) 00000100:00100000:1.0:1789135796.578692:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+57:11872:x1876044512586880:12345-192.168.206.35@tcp:101:bash.0 Request processed in 4529us (4857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135796.578699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 209 00000100:00100000:3.0:1789135796.587292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135796.587497:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512587264 00000100:00100000:2.0:1789135796.587518:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512587264 00000100:00100000:2.0:1789135796.587568:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:2.0:1789135796.587577:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+57:11872:x1876044512587264:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:2.0:1789135796.587780:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11872:x1876044512587264:12345-192.168.206.35@tcp:35:bash.0 Request processed in 203us (497us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789135796.587789:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 59 00000100:00100000:3.0:1789135796.634524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135796.634717:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512587392 00000100:00100000:0.0:1789135796.634727:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512587392 00000100:00100000:0.0:1789135796.634840:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 210 00000100:00100000:0.0:1789135796.634851:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+58:11878:x1876044512587392:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135796.634872:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135796.634921:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4dd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d389f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.634994:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4dd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.635007:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.635017:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135796.635110:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1789135796.635114:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135796.635428:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.635454:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4dd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d389f expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.635707:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d389f expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.635716:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:0.0:1789135796.635719:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135796.635723:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031800, rc 0) 00000100:00100000:0.0:1789135796.636334:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11878:x1876044512587392:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1482us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135796.636343:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 210 00000100:00100000:3.0:1789135796.639571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.640321:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512587520 00000100:00100000:1.0:1789135796.640330:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512587520 00000100:00100000:1.0:1789135796.640394:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 211 00000100:00100000:1.0:1789135796.640405:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41d7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11878:x1876044512587520:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135796.640424:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135796.640459:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38a6 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640519:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640533:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640544:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640559:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640566:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640572:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640662:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640670:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640676:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135796.640707:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789135796.640710:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789135796.640726:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640745:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640753:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640759:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640765:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640772:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135796.640781:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640788:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640799:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135796.640803:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135796.640807:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640813:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640916:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640921:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640932:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.640937:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135796.641333:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.641344:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.641353:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135796.641356:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135796.641359:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.641365:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.641400:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481400/0x5b09da6ee1ce4ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 61 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.641412:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 60 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.641418:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135796.641420:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135796.641422:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481200, rc 0) 00000100:00100000:1.0:1789135796.641487:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41d7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11878:x1876044512587520:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1084us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135796.641504:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 211 00000100:00100000:3.0:1789135796.644949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135796.644994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.645247:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512587776 00000100:00100000:1.0:1789135796.645256:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512587776 00000100:00100000:1.0:1789135796.645302:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 212 00000100:00100000:1.0:1789135796.645311:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11878:x1876044512587776:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135796.645330:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135796.645348:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.645437:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.645450:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.645459:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 61 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.645467:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.645497:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 61 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.645509:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 61 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.645521:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545086848:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135796.645629:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.645639:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 61 pid: 5837 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.645648:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545086976:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135796.645674:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135796.646269:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512587904 00000100:00100000:2.0:1789135796.646276:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512587904 00010000:00010000:2.0:1789135796.646302:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 62 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135796.646334:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:2.0:1789135796.646342:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+62:2377:x1876044512587904:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135796.646351:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135796.646357:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 62 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.646368:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 62 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.646386:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:2.0:1789135796.646398:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.646405:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.646411:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135796.646441:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+62:2377:x1876044512587904:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 100us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135796.646448:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:3.0:1789135796.650237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:1.0:1789135796.650425:0:5837:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.35@tcp) returned -22 from blocking AST (req@00000000a4564ead x1876044545086848) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 61 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.650444:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4df4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38a6 expref: 61 pid: 11758 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135796.650461:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545086848:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135796.650476:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1876044545086976:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135796.650501:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135796.650506:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.650515:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.650524:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135796.650937:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512588032 00000100:00100000:2.0:1789135796.650944:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512588032 00010000:00010000:2.0:1789135796.650987:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 61 pid: 5837 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135796.651026:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:2.0:1789135796.651034:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+61:2376:x1876044512588032:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135796.651049:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135796.651054:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 61 pid: 5837 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.651100:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 61 pid: 5837 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.651121:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4dca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3898 expref: 61 pid: 5837 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.651144:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:2.0:1789135796.651161:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.651169:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.651177:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.651200:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135796.651246:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+60:2376:x1876044512588032:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 213us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135796.651255:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 87 00010000:00010000:1.0:1789135796.651835:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.651927:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135796.652010:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789135796.652220:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4dfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.652235:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.652242:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135796.652245:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135796.652248:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481a00, rc 0) 00000100:00100000:1.0:1789135796.652298:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc1954c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11878:x1876044512587776:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 6987us (7365us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789135796.652305:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 212 00000100:00100000:3.0:1789135796.655134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135796.655248:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512588288 00000100:00100000:2.0:1789135796.655258:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512588288 00000100:00100000:2.0:1789135796.655314:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:2.0:1789135796.655324:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05777450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11878:x1876044512588288:12345-192.168.206.35@tcp:103:lfs.0 00010000:00010000:2.0:1789135796.655339:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135796.655361:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce4d61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3883 expref: 60 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135796.655377:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:2.0:1789135796.655382:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135796.655439:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05777450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11878:x1876044512588288:12345-192.168.206.35@tcp:103:lfs.0 Request processed in 116us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135796.655446:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:3.0:1789135796.657740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135796.657934:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512588416 00000100:00100000:0.0:1789135796.657942:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512588416 00000100:00100000:0.0:1789135796.658047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 213 00000100:00100000:0.0:1789135796.658057:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11878:x1876044512588416:12345-192.168.206.35@tcp:58:lfs.0 00010000:00010000:0.0:1789135796.658191:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.658206:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135796.658218:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789135796.658388:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789135796.658483:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11878:x1876044512588416:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 427us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135796.658490:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 213 00000100:00100000:3.0:1789135796.661157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135796.661513:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512588544 00000100:00100000:1.0:1789135796.661522:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512588544 00000100:00100000:1.0:1789135796.661630:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 214 00000100:00100000:1.0:1789135796.661641:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc057f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+59:11878:x1876044512588544:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:1.0:1789135796.661660:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135796.661685:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38b4 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.661752:0:11758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.661779:0:11758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38b4 expref: 60 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.661797:0:11758:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.661810:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38b4 expref: 60 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.661832:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135796.661835:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135796.661839:0:11758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38b4 expref: 60 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135796.661846:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481200, rc 0) 00000100:00100000:1.0:1789135796.661920:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc057f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11878:x1876044512588544:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 281us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135796.661927:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 214 00010000:00010000:2.0:1789135796.940566:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135797.132311:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135797.132332:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135797.132373:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789135797.132380:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135797.132493:0:12074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ed680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545087104:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135797.132600:0:12074:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05334a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135797.135367:0:12074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ed680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545087104:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135797.137760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.138619:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512588672 00000100:00100000:1.0:1789135797.138630:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512588672 00000100:00100000:1.0:1789135797.138697:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 215 00000100:00100000:1.0:1789135797.138708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11879:x1876044512588672:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789135797.138737:0:5837:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789135797.138854:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11879:x1876044512588672:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 147us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135797.138862:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 215 00000100:00100000:3.0:1789135797.149133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.149489:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512588800 00000100:00100000:0.0:1789135797.149498:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512588800 00000100:00100000:0.0:1789135797.149729:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 216 00000100:00100000:0.0:1789135797.149741:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11879:x1876044512588800:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789135797.149805:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.149839:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.149856:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.149962:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.149970:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.149978:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150001:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150009:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150016:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135797.150050:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789135797.150055:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135797.150094:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150105:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150122:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150129:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150134:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135797.150138:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150146:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150238:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:0.0:1789135797.150242:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135797.150252:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150259:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce4e1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150273:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150279:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150285:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150290:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135797.150299:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150306:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150314:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8adc062d3200) 00010000:00010000:0.0:1789135797.150316:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135797.150319:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150324:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce4e25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150340:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150346:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150356:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150361:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135797.150364:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150370:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150377:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:0.0:1789135797.150380:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135797.150389:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.150394:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.150492:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11879:x1876044512588800:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 752us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135797.150500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 216 00000100:00100000:2.0:1789135797.153418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.153564:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512589056 00000100:00100000:1.0:1789135797.153573:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512589056 00000100:00100000:1.0:1789135797.153629:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 217 00000100:00100000:1.0:1789135797.153639:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+60:11879:x1876044512589056:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135797.153658:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135797.153677:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38bb expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.153762:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.153777:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.153788:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135797.153798:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789135797.153919:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.153927:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.153934:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.153940:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135797.153945:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.153952:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.154377:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135797.154380:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789135797.154385:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.154392:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.154434:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e33 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38bb expref: 62 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.154443:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:1.0:1789135797.154446:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135797.154784:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38bb expref: 62 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.154796:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481c00, rc 0) 00000100:00100000:1.0:1789135797.155162:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+61:11879:x1876044512589056:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1523us (1752us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1789135797.155171:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 217 00000100:00100000:3.0:1789135797.161662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.161751:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512589184 00000100:00100000:0.0:1789135797.161760:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512589184 00000100:00100000:0.0:1789135797.161814:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 218 00000100:00100000:0.0:1789135797.161822:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+61:11879:x1876044512589184:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135797.161851:0:7852:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135797.161953:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+61:11879:x1876044512589184:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 132us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135797.161960:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 218 00000100:00100000:2.0:1789135797.168658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.169159:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512589440 00000100:00100000:0.0:1789135797.169168:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512589440 00000100:00100000:1.0:1789135797.169267:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 219 00000100:00100000:1.0:1789135797.169279:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+61:11879:x1876044512589440:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135797.169298:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135797.169301:0:11758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789135797.169325:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031800/0x5b09da6ee1ce4dd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d389f expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.169366:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135797.169372:0:11758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135797.169385:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38c2 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135797.169714:0:11758:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1789135797.170050:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.170106:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.170116:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.170159:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c2 expref: 63 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.170173:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c2 expref: 62 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.170181:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:1.0:1789135797.170183:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135797.170186:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480c00, rc 0) 00000100:00100000:1.0:1789135797.170251:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+62:11879:x1876044512589440:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 976us (1601us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789135797.170259:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 219 00000100:00100000:1.0:1789135797.175953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.176132:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512589696 00000100:00100000:3.0:1789135797.176142:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512589696 00000100:00100000:3.0:1789135797.176199:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 220 00000100:00100000:3.0:1789135797.176209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+62:11879:x1876044512589696:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135797.176270:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135797.176294:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4e4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c2 expref: 62 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176309:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1953ca00) 00010000:00010000:3.0:1789135797.176317:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135797.176334:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176345:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176366:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176382:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176390:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176397:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176480:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176487:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176493:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176499:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135797.176503:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176510:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176519:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135797.176522:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135797.176525:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176537:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e800/0x5b09da6ee1ce4e5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176547:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176551:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176556:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176560:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135797.176563:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176568:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176575:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x211e56d7 (ffff8adc02cc5100) 00010000:00010000:3.0:1789135797.176577:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135797.176579:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.176584:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f000/0x5b09da6ee1ce4e64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x211e56d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135797.176666:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+61:11879:x1876044512589696:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 458us (721us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135797.178807:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 220 00000100:00100000:3.0:1789135797.180116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135797.180403:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512589824 00000100:00100000:2.0:1789135797.180412:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512589824 00000100:00100000:2.0:1789135797.180453:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 221 00000100:00100000:2.0:1789135797.180473:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+61:11879:x1876044512589824:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135797.180491:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135797.180512:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4e6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38c9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.180543:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.180555:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.180565:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.180645:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2800/0x5b09da6ee1ce4e6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.180659:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.180667:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135797.180670:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135797.180674:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3c00, rc 0) 00000100:00100000:2.0:1789135797.181219:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc342ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+62:11879:x1876044512589824:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 745us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135797.181284:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 221 00000100:00100000:2.0:1789135797.188389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.188566:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512590080 00000100:00100000:1.0:1789135797.188576:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512590080 00000100:00100000:1.0:1789135797.188686:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 222 00000100:00100000:1.0:1789135797.188696:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+62:11879:x1876044512590080:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135797.188791:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.188807:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.188818:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135797.189106:0:11758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1789135797.189116:0:11758:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420761052619ns, next at 421761050585ns, rc = 0 00000004:00010000:1.0:1789135797.189394:0:11758:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e3308d3c reply state 00000000d513307a transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135797.189403:0:11758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135797.189702:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+64:11879:x1876044512590080:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 1006us (1321us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789135797.189710:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 222 00000100:00100000:3.0:1789135797.193572:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:0.0:1789135797.193634:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.193645:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.193652:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.193657:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135797.193661:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.193691:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.193707:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135797.193709:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135797.193714:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.193721:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4e79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135797.193989:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512590208 00000100:00100000:1.0:1789135797.193997:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512590208 00000100:00100000:1.0:1789135797.194084:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 223 00000100:00100000:1.0:1789135797.194094:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc156f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+63:11879:x1876044512590208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135797.194115:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135797.194130:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38d0 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.194197:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 64 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.194210:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 64 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.194238:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:1.0:1789135797.194241:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135797.194244:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480e00, rc 0) 00000100:00100000:1.0:1789135797.195319:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc156f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+64:11879:x1876044512590208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1221us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135797.195329:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 223 00000100:00100000:3.0:1789135797.198218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.198711:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512590336 00000100:00100000:1.0:1789135797.198722:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512590336 00000100:00100000:1.0:1789135797.198844:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:1.0:1789135797.198855:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2378:x1876044512590336:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789135797.199534:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a302580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2378:x1876044512590336:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 679us (1322us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789135797.199543:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00080000:2.0:1789135797.203436:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135797.203903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.204410:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512590592 00000100:00100000:3.0:1789135797.204420:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512590592 00000100:00100000:2.0:1789135797.204622:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:2.0:1789135797.204633:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+64:11879:x1876044512590592:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789135797.204856:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+65:11879:x1876044512590592:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 223us (956us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789135797.204864:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 60 00000100:00100000:0.0:1789135797.211490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135797.215859:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512590848 00000100:00100000:2.0:1789135797.215872:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512590848 00000100:00100000:2.0:1789135797.216039:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 224 00000100:00100000:2.0:1789135797.216048:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+65:11879:x1876044512590848:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135797.216181:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+65:11879:x1876044512590848:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 133us (4701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135797.216189:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 224 00000100:00100000:3.0:1789135797.229903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.230022:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512590976 00000100:00100000:0.0:1789135797.230032:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512590976 00000100:00100000:0.0:1789135797.230125:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 225 00000100:00100000:0.0:1789135797.230135:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+65:11879:x1876044512590976:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135797.230153:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135797.230173:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4e87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.230239:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4e8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.230252:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.230264:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135797.230297:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135797.230334:0:5838:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.230360:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4e87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d7 expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.230377:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d7 expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.230384:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135797.230387:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789135797.230390:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045c00, rc 0) 00000100:00100000:0.0:1789135797.230457:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34bca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+66:11879:x1876044512590976:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 323us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135797.230464:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 225 00000100:00100000:1.0:1789135797.233004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.235550:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512591104 00000100:00100000:3.0:1789135797.235621:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512591104 00000100:00100000:3.0:1789135797.235691:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:3.0:1789135797.235700:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+10:2376:x1876044512591104:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135797.235717:0:6765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135797.235736:0:6765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38de expref: -99 pid: 6765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135797.235762:0:6765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40bb5, blocks: 0x1 00010000:00010000:3.0:1789135797.235779:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1789135797.235783:0:6765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135797.235792:0:6765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 11 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.235807:0:6765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 11 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.235819:0:6765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f000, rc 0) 00000100:00100000:3.0:1789135797.235889:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+11:2376:x1876044512591104:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 177us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135797.235896:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:2.0:1789135797.243374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.245242:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512591360 00000100:00100000:1.0:1789135797.245255:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512591360 00000100:00100000:1.0:1789135797.245320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 226 00000100:00100000:1.0:1789135797.245330:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+66:11879:x1876044512591360:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789135797.245454:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+66:11879:x1876044512591360:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 124us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135797.245484:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 226 00000100:00100000:2.0:1789135797.250214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.250339:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512591488 00000100:00100000:3.0:1789135797.250350:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512591488 00000100:00100000:3.0:1789135797.250483:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:3.0:1789135797.250505:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+11:11879:x1876044512591488:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135797.250522:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135797.250538:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38e5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.250567:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 12 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.250577:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135797.250581:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135797.250587:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.250617:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 12 pid: 6765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.250631:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 12 pid: 6765 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135797.250644:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545087232:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135797.250758:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135797.253304:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545087232:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135797.253337:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.253368:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e800, rc 0) 00000100:00100000:2.0:1789135797.253418:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+12:11879:x1876044512591488:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2926us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135797.253627:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:3.0:1789135797.255648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.255726:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512591616 00000100:00100000:0.0:1789135797.255740:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512591616 00010000:00010000:0.0:1789135797.255782:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 12 pid: 6765 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.255830:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:0.0:1789135797.255840:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+12:2375:x1876044512591616:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135797.255852:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135797.255873:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 12 pid: 6765 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.255900:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 12 pid: 6765 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.255932:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce4e95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38de expref: 12 pid: 6765 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.255948:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135797.255952:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135797.255960:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.255982:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.256017:0:8444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.256031:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8444:1876044545087360:192.168.206.35@tcp:105: 00000100:00100000:0.0:1789135797.256143:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05334840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135797.258673:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8444:1876044545087360:192.168.206.35@tcp:105: 00010000:00010000:0.0:1789135797.258694:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135797.258754:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+11:2375:x1876044512591616:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 2915us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135797.258764:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:2.0:1789135797.262804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.264827:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512591744 00000100:00100000:1.0:1789135797.264841:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512591744 00002000:00100000:1.0:1789135797.264906:0:6686:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8adc19454b40 x1876044512591744/t0(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:228/0 lens 504/0 e 0 to 0 dl 1789135808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135797.264918:0:6686:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc19454b40 with x1876044512591744 ext(0->12) 00002000:00010000:1.0:1789135797.264924:0:6686:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc19454b40 00000100:00100000:1.0:1789135797.265010:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:1.0:1789135797.265020:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc19454b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+11:2376:x1876044512591744:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789135797.268736:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc19454b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+13:2376:x1876044512591744:12345-192.168.206.35@tcp:4:lhsmtool_posix.0 Request processed in 3707us (5929us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789135797.268751:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00002000:00100000:1.0:1789135797.268763:0:6686:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8adc19454b40 x1876044512591744/t4294967320(0) o4->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:228/0 lens 504/448 e 0 to 0 dl 1789135808 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135797.268773:0:6686:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc19454b40 with x1876044512591744 ext(0->12) 00002000:00010000:1.0:1789135797.268780:0:6686:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc19454b40 00000100:00100000:0.0:1789135797.276593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.276760:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512591872 00000100:00100000:3.0:1789135797.276786:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512591872 00000100:00100000:3.0:1789135797.276862:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 227 00000100:00100000:3.0:1789135797.276873:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+66:11879:x1876044512591872:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789135797.373523:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+66:11879:x1876044512591872:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 96643us (96930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135797.373538:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 227 00000001:00080000:0.0:1789135797.375680:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967483 is committed 00000001:00080000:0.0:1789135797.375712:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1789135797.375732:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:2.0:1789135797.376228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000001:00080000:0.0:1789135797.376807:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1789135797.376916:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789135797.376939:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adc11ee7480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789135797.376943:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc079e7c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adc11ee7e40 00000020:00080000:0.0:1789135797.376946:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc079e7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc34bd1400 00000004:00080000:0.0:1789135797.376962:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:2.0:1789135797.377166:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135797.377187:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545087488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789135797.377244:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135797.377754:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512592000 00000100:00100000:3.0:1789135797.377764:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512592000 00000100:00100000:3.0:1789135797.377842:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545087488 00000100:00100000:3.0:1789135797.377845:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545087488 00000100:00100000:3.0:1789135797.377872:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:3.0:1789135797.377893:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+13:2375:x1876044512592000:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789135797.378272:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789135797.378282:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1876044545087488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789135797.378298:0:6680:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1789135797.378327:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa40bb4, atime: 0x6aa40bb4, ctime: 0x6aa40bb4, blocks: 0x1 00010000:00010000:2.0:1789135797.378335:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.378349:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=420s v=(0 0) 00010000:00010000:2.0:1789135797.378353:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135797.378359:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.378374:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.378385:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.378392:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.378419:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789135797.379262:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1876044545087488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 979us (2014us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789135797.379271:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1789135797.379588:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc3a2eb840/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789135797.379596:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545087488:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789135797.381890:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135797.381903:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.381915:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2a00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135797.381920:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.381931:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.381955:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.381963:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce4ea3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.382004:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135797.382006:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135797.382008:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135797.382712:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:0.0:1789135797.382845:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adc04698300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789135797.382850:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc079e7200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adc04698600 00000020:00080000:0.0:1789135797.382853:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc079e7100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc3403b000 00000020:00080000:0.0:1789135797.382863:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1789135797.382916:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789135797.383144:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789135797.386762:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135797.386792:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545087744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789135797.386888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135797.391581:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545087616:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789135797.391651:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135797.392283:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545087744 00000100:00100000:2.0:1789135797.392291:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545087744 00000100:00100000:2.0:1789135797.392353:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545087616 00000100:00100000:2.0:1789135797.392357:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545087616 00000100:00100000:2.0:1789135797.392374:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789135797.392382:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876044545087744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789135797.392595:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789135797.392599:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789135797 00002000:00010000:2.0:1789135797.392601:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789135797.392603:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789135797 -> 1789135797 00002000:00010000:2.0:1789135797.392606:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789135797.392658:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1876044545087744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 277us (5770us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789135797.392666:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789135797.392686:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789135797.392692:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1876044545087616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789135797.392706:0:6682:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1789135797.392724:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.392973:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.392981:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789135797.392986:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135797.392990:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.393023:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.393038:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 13 pid: 6680 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135797.393057:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545087872:192.168.206.35@tcp:104: 00000100:00080000:3.0:1789135797.393230:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135797.393584:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6eb40 going to sleep for 11 seconds 00000004:00080000:2.0:1789135797.393620:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc3a2fcb40/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789135797.393627:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545087744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789135797.406181:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545087872:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135797.406209:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135797.410584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.411268:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512592128 00000100:00100000:3.0:1789135797.411280:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512592128 00010000:00010000:3.0:1789135797.411323:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 14 pid: 6680 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135797.411365:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:3.0:1789135797.411374:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+14:2375:x1876044512592128:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135797.411388:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135797.411394:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 14 pid: 6680 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.411407:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 14 pid: 6680 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.411430:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026dfe21d/0x5b09da6ee1ce4c65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3844 expref: 14 pid: 6680 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.411446:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135797.411471:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135797.411477:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.411487:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.411520:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135797.411573:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+13:2375:x1876044512592128:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 201us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135797.411581:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 89 00010000:00010000:1.0:1789135797.411692:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.411714:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.411725:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.411733:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.411762:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789135797.412291:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1876044545087616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19598us (20638us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789135797.412299:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1789135797.412342:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc3a2fc000/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789135797.412347:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545087616:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789135797.413954:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135797.413967:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.413980:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135797.413985:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.413996:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.414018:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.414025:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000228cfe45/0x5b09da6ee1ce4eaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.414103:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135797.414106:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135797.414108:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789135797.496191:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1789135797.496207:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1789135797.496659:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512592000:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 118763us (120430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135797.496670:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:2.0:1789135797.516601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.516684:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512592384 00000100:00100000:1.0:1789135797.516693:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512592384 00000100:00100000:1.0:1789135797.516755:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 228 00000100:00100000:1.0:1789135797.516765:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+20:11879:x1876044512592384:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135797.516831:0:11758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135797.516857:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045c00/0x5b09da6ee1ce4e8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d7 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.516885:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:1.0:1789135797.516904:0:11758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135797.516932:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.516946:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.516957:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135797.517237:0:11758:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ba083990 reply state 0000000025fe0156 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135797.517257:0:11758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135797.517342:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+21:11879:x1876044512592384:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 578us (749us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789135797.517350:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 228 00010000:00010000:2.0:1789135797.539541:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.539557:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.539583:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.539589:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135797.539594:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.539602:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.539618:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135797.539622:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135797.539626:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.539632:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481e00/0x5b09da6ee1ce4eb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135797.540417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.540488:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512592512 00000100:00100000:0.0:1789135797.540497:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512592512 00000100:00100000:0.0:1789135797.540552:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:0.0:1789135797.540560:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512592512:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789135797.540737:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789135797.540741:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789135797 -> 1789135796 00002000:00010000:0.0:1789135797.540754:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789135796 00002000:00010000:0.0:1789135797.540756:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789135797 -> 1789135796 00002000:00010000:0.0:1789135797.540758:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789135797.540868:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512592512:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 308us (455us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789135797.540898:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:0.0:1789135797.563205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135797.563343:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512592768 00000100:00100000:2.0:1789135797.563353:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512592768 00000100:00100000:2.0:1789135797.563411:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 229 00000100:00100000:2.0:1789135797.563421:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+20:11879:x1876044512592768:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789135797.563493:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.563510:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.563539:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.563573:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.563587:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 20 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135797.563601:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1876044545088000:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135797.563687:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13eac600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135797.566522:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1876044545088000:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135797.566550:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135797.566652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135797.566737:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512592896 00000100:00100000:2.0:1789135797.566752:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512592896 00010000:00010000:2.0:1789135797.566784:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 21 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135797.566826:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 90 00000100:00100000:2.0:1789135797.566835:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+21:2375:x1876044512592896:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135797.566849:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135797.566855:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 21 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.566894:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 21 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.566916:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3c00/0x5b09da6ee1ce4e72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38c9 expref: 21 pid: 5836 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.566930:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135797.566934:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.566943:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.566950:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.566971:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135797.567014:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+20:2375:x1876044512592896:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 179us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135797.567022:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 90 00010000:00010000:2.0:1789135797.567056:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.567097:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.567121:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.567138:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.567145:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.567151:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135797.567155:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.567163:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.567172:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135797.567175:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789135797.567179:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.567185:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3200/0x5b09da6ee1ce4eb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135797.567223:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11879:x1876044512592768:12345-192.168.206.35@tcp:55:lhsmtool_posix.0 Request processed in 3804us (4027us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789135797.567231:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 229 00000100:00100000:3.0:1789135797.569726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.569909:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512593024 00000100:00100000:1.0:1789135797.569919:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512593024 00000100:00100000:1.0:1789135797.569970:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:1.0:1789135797.569979:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512593024:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789135797.570019:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.570207:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.570216:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789135797.570234:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135797.570239:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.570272:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.570286:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 8 pid: 6682 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135797.570301:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41bf8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545088128:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135797.570367:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135797.575621:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41bf8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876044545088128:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135797.575653:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135797.577797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.578282:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512593152 00000100:00100000:0.0:1789135797.578290:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512593152 00010000:00010000:0.0:1789135797.578327:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 9 pid: 6682 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.578369:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:0.0:1789135797.578379:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+9:2375:x1876044512593152:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135797.578393:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135797.578413:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 9 pid: 6682 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.578427:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 9 pid: 6682 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.578450:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000017a8844/0x5b09da6ee1ce4e9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38e5 expref: 9 pid: 6682 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.578478:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135797.578482:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135797.578488:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.578497:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.578546:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135797.578605:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512593152:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 228us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135797.578613:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 91 00010000:00010000:1.0:1789135797.581219:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.581242:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.581280:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.581289:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.581314:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.581321:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135797.581326:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.581335:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.581352:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.581360:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001080f981/0x5b09da6ee1ce4ebf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135797.581464:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512593024:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 11473us (11732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135797.581473:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 70 00000100:00100000:3.0:1789135797.588333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.588444:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512593408 00000100:00100000:0.0:1789135797.588464:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512593408 00000100:00100000:0.0:1789135797.588511:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 230 00000100:00100000:0.0:1789135797.588522:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11879:x1876044512593408:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789135797.588594:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.588610:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.588620:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.588819:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.588831:0:7852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 20 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.588839:0:7852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.588868:0:7852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 20 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.588911:0:7852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 20 pid: 11758 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.588926:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545088256:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135797.589010:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05334c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135797.601254:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545088256:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135797.601284:0:7852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135797.601443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.602210:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512593536 00000100:00100000:0.0:1789135797.602218:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512593536 00010000:00010000:0.0:1789135797.602255:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 21 pid: 11758 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.602296:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:0.0:1789135797.602304:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+21:2375:x1876044512593536:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135797.602318:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135797.602324:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 21 pid: 11758 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.602336:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 21 pid: 11758 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.602358:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480e00/0x5b09da6ee1ce4e80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38d0 expref: 21 pid: 11758 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.602373:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135797.602377:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.602403:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.602410:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.602434:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135797.602822:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+20:2375:x1876044512593536:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 506us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135797.602830:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 92 00010000:00010000:3.0:1789135797.603213:0:7852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.603223:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135797.603396:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789135797.603751:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789135797.603801:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789135797.603913:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545088384:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789135797.603964:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135797.603997:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135797.604639:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545088384 00000100:00100000:0.0:1789135797.604646:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545088384 00000100:00100000:0.0:1789135797.604686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135797.604694:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7852:x1876044545088384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135797.604778:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7852:x1876044545088384:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135797.604786:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135797.604838:0:7852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1789135797.604844:0:7852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1789135797.604865:0:7852:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8adc3a2fcb40 x1876044545087744/t4294967321(4294967321) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789135813 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135797.604889:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545088384:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789135797.606704:0:7852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789135797.606805:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a3eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545088512:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135797.606883:0:7852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135797.606910:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05334c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135797.607353:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545088512 00000100:00100000:2.0:1789135797.607361:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545088512 00000100:00100000:2.0:1789135797.607396:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135797.607405:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a3ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7852:x1876044545088512:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789135797.607618:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a3ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7852:x1876044545088512:12345-0@lo:1000:mdt00_003.0 Request processed in 214us (743us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789135797.607626:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789135797.610645:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a3eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7852:1876044545088512:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789135797.610696:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610707:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610715:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610721:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135797.610726:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610734:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610762:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135797.610766:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135797.610771:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610778:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4ecd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610817:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610824:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610830:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610850:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135797.610853:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610859:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610869:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:0.0:1789135797.610871:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135797.610888:0:7852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38b4 expref: 23 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.610900:0:7852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38b4 expref: 23 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.611731:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38b4 expref: 23 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.611949:0:7852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38b4 expref: 23 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.611964:0:7852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545088640:192.168.206.35@tcp:105: 00000100:00100000:0.0:1789135797.613407:0:7852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12c7ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135797.620817:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.620939:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512593664 00000100:00100000:1.0:1789135797.620947:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512593664 00000100:00100000:1.0:1789135797.621000:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:1.0:1789135797.621010:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11878:x1876044512593664:12345-192.168.206.35@tcp:49:lfs.0 00000100:00100000:1.0:1789135797.621174:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11878:x1876044512593664:12345-192.168.206.35@tcp:49:lfs.0 Request processed in 165us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135797.621191:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 61 00000100:00100000:3.0:1789135797.623643:0:7852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7852:1876044545088640:192.168.206.35@tcp:105: 00010000:00010000:3.0:1789135797.623671:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623691:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce4e10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623721:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623734:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623849:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623861:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623867:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623883:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623889:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135797.623893:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623900:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623910:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:3.0:1789135797.623912:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135797.623916:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623928:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4ed4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623938:0:7852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623943:0:7852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623949:0:7852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623954:0:7852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135797.623957:0:7852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623962:0:7852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623969:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:3.0:1789135797.623971:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135797.623974:0:7852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.623979:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045a00/0x5b09da6ee1ce4ec6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.624846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.625288:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512593920 00000100:00100000:3.0:1789135797.625295:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512593920 00000100:00100000:3.0:1789135797.625337:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 231 00000100:00100000:3.0:1789135797.625345:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11878:x1876044512593920:12345-192.168.206.35@tcp:58:lfs.0 00000040:00080000:3.0:1789135797.625629:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000040:00080000:0.0:1789135797.625807:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135797.625811:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135797.625852:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789135797.625857:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135797.625947:0:12074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34e5b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545088768:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135797.626009:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+25:11879:x1876044512593408:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 37487us (37683us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789135797.626018:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 230 00000020:00080000:2.0:1789135797.626023:0:7852:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789135797.626377:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+24:11878:x1876044512593920:12345-192.168.206.35@tcp:58:lfs.0 Request processed in 1030us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135797.626384:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 231 00000100:00100000:0.0:1789135797.631844:0:12074:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc12c7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135797.646001:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.646488:0:12074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34e5b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12074:1876044545088768:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135797.646827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512594048 00000100:00100000:3.0:1789135797.646834:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512594048 00000100:00100000:3.0:1789135797.646944:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 232 00000100:00100000:3.0:1789135797.646954:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+23:11880:x1876044512594048:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135797.646982:0:5836:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135797.647105:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+23:11880:x1876044512594048:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 152us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135797.647113:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 232 00000100:00100000:0.0:1789135797.647538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135797.647561:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512594304 00000100:00100000:0.0:1789135797.647565:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512594304 00000100:00100000:0.0:1789135797.647585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 62 00000100:00100000:0.0:1789135797.647591:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+23:11879:x1876044512594304:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789135797.649007:0:5840:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789135797.651489:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1789135797.651565:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.651581:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.651593:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.651602:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.651610:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.651617:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135797.651645:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135797.651909:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135797.651916:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.651922:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135797.651926:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.651934:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.651948:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8adc062d3a00) 00010000:00010000:2.0:1789135797.651950:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789135797.651955:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.651961:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045000/0x5b09da6ee1ce4edb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135797.651978:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135797.651980:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135797.651981:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135797.652890:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+25:11879:x1876044512594304:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 5280us (5334us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789135797.652902:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 62 00000020:00080000:0.0:1789135797.652908:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789135797.665372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.665446:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512594560 00000100:00100000:1.0:1789135797.665464:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512594560 00000100:00100000:1.0:1789135797.665516:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 233 00000100:00100000:1.0:1789135797.665526:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+25:11880:x1876044512594560:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135797.665546:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135797.665565:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ee2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38ec expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.665648:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4ee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.665662:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.665673:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135797.665683:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789135797.665817:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481c00/0x5b09da6ee1ce4ee2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ec expref: 28 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.665835:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ec expref: 27 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.665843:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135797.665846:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789135797.665849:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480c00, rc 0) 00000100:00100000:1.0:1789135797.667705:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+27:11880:x1876044512594560:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 2173us (2335us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789135797.667716:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 233 00000100:00100000:0.0:1789135797.675929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.675994:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512594816 00000100:00100000:1.0:1789135797.676002:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512594816 00000100:00100000:1.0:1789135797.676099:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 234 00000100:00100000:1.0:1789135797.676109:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+27:11880:x1876044512594816:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789135797.676187:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676203:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676214:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676375:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676383:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676389:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676395:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135797.676399:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676405:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676427:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135797.676430:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135797.676434:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.676441:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481000/0x5b09da6ee1ce4ef7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135797.676584:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f7ef768-1508-4eda-9824-c10078b0a61e+28:11880:x1876044512594816:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 475us (662us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789135797.676592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 234 00000040:00080000:0.0:1789135797.677399:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135797.677404:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789135797.679251:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.679399:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512595072 00000100:00100000:3.0:1789135797.679408:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512595072 00000100:00100000:3.0:1789135797.679466:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 63 00000100:00100000:3.0:1789135797.679476:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+28:11880:x1876044512595072:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789135797.679681:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+29:11880:x1876044512595072:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 206us (435us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789135797.679689:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 63 00000040:00080000:0.0:1789135797.681348:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789135797.681363:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135797.688859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.689642:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512595200 00000100:00100000:3.0:1789135797.689652:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512595200 00000100:00100000:3.0:1789135797.689713:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 235 00000100:00100000:3.0:1789135797.689734:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+29:11882:x1876044512595200:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135797.689854:0:11758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135797.689884:0:11758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4efe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38f3 expref: -99 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.689953:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.689966:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.689975:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.689988:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.689995:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.690001:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.690409:0:11758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.690420:0:11758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.690428:0:11758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.690713:0:11758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.690886:0:11758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 30 pid: 5837 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135797.690900:0:11758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545088896:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135797.691036:0:11758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05772840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135797.694665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135797.695360:0:11758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11758:1876044545088896:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135797.695388:0:11758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135797.695519:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512595456 00000100:00100000:0.0:1789135797.695527:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512595456 00000100:00100000:0.0:1789135797.695636:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:0.0:1789135797.695646:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+31:5618:x1876044512595456:12345-192.168.206.35@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789135797.695997:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+32:5618:x1876044512595456:12345-192.168.206.35@tcp:35:ldlm_bl.0 Request processed in 351us (1338us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789135797.696006:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 64 00000100:00100000:2.0:1789135797.699429:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135797.699523:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512595584 00000100:00100000:1.0:1789135797.699531:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512595584 00010000:00010000:1.0:1789135797.699570:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 32 pid: 5837 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135797.699610:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:1.0:1789135797.699618:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+32:2376:x1876044512595584:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135797.699633:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135797.699639:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 32 pid: 5837 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.699651:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 32 pid: 5837 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.699671:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481a00/0x5b09da6ee1ce4e02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ad expref: 32 pid: 5837 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.699705:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135797.699711:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.699720:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.699738:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135797.699884:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135797.699936:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+31:2376:x1876044512595584:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 318us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135797.699944:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 93 00010000:00010000:3.0:1789135797.700423:0:11758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700431:0:11758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135797.700468:0:11758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789135797.700472:0:11758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135797.700489:0:11758:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700500:0:11758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700508:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700514:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700532:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700538:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135797.700541:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700548:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700558:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:3.0:1789135797.700561:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135797.700564:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700570:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700580:0:11758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700586:0:11758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700591:0:11758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700596:0:11758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fc00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135797.700599:0:11758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700613:0:11758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700621:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8adc02cc5600) 00010000:00010000:3.0:1789135797.700623:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135797.700626:0:11758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700631:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700663:0:11758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4efe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38f3 expref: 31 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700676:0:11758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38f3 expref: 30 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135797.700683:0:11758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:3.0:1789135797.700685:0:11758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135797.700687:0:11758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f200, rc 0) 00000100:00100000:3.0:1789135797.701002:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+30:11882:x1876044512595200:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 11279us (12149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135797.701010:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 235 00010000:00010000:3.0:1789135797.970321:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789135798.725680:0:12946:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135798.725689:0:12946:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135798.725729:0:12946:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789135798.725734:0:12946:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135798.869416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135798.870268:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512595840 00000100:00100000:3.0:1789135798.870277:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512595840 00000100:00100000:3.0:1789135798.870343:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 236 00000100:00100000:3.0:1789135798.870357:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+30:11905:x1876044512595840:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135798.870388:0:7852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135798.870407:0:7852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d38fa expref: -99 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.870490:0:7852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4f21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.870504:0:7852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4f21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.870515:0:7852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4f21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135798.870525:0:7852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789135798.870633:0:7852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38fa expref: 33 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.870647:0:7852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4f21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38fa expref: 32 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.870655:0:7852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:3.0:1789135798.870658:0:7852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789135798.870661:0:7852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31ec00, rc 0) 00000100:00100000:3.0:1789135798.870709:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11905:x1876044512595840:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 358us (1302us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789135798.870716:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 236 00000100:00080000:2.0:1789135798.870848:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135798.873966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135798.874202:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512595968 00000100:00100000:3.0:1789135798.874211:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512595968 00000100:00100000:3.0:1789135798.874334:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 237 00000100:00100000:3.0:1789135798.874353:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11905:x1876044512595968:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:3.0:1789135798.874415:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874431:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874442:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874465:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874472:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874478:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874485:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135798.874488:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874495:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874504:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:3.0:1789135798.874507:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135798.874511:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135798.874516:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f400/0x5b09da6ee1ce4f2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135798.874593:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+32:11905:x1876044512595968:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 243us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135798.874600:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 237 00000100:00100000:2.0:1789135798.981378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135798.982474:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512596096 00000100:00100000:0.0:1789135798.982485:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512596096 00000100:00100000:0.0:1789135798.982556:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:0.0:1789135798.982567:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512596096:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:0.0:1789135798.982584:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135798.982603:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4f36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3901 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135798.982652:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa40bb4, atime: 0x6aa40bb4, ctime: 0x6aa40bb4, blocks: 0xb 00010000:00010000:0.0:1789135798.982672:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1789135798.982677:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135798.982686:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3901 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135798.982704:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3901 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135798.982717:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045c00, rc 0) 00000100:00100000:0.0:1789135798.982782:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512596096:12345-192.168.206.35@tcp:101:cat.0 Request processed in 217us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135798.982790:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 71 00000100:00100000:2.0:1789135798.985674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135798.985902:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512596224 00000100:00100000:0.0:1789135798.985912:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512596224 00002000:00100000:0.0:1789135798.985960:0:6685:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8adc3a2eb0c0 x1876044512596224/t0(0) o3->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:229/0 lens 488/0 e 0 to 0 dl 1789135809 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135798.985972:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3a2eb0c0 with x1876044512596224 ext(0->4095) 00002000:00010000:0.0:1789135798.985978:0:6685:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc3a2eb0c0 00000100:00100000:0.0:1789135798.986008:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1789135798.986018:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512596224:12345-192.168.206.35@tcp:3:cat.0 00000100:00100000:0.0:1789135798.986281:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2376:x1876044512596224:12345-192.168.206.35@tcp:3:cat.0 Request processed in 264us (615us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789135798.986300:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00002000:00100000:0.0:1789135798.986308:0:6685:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8adc3a2eb0c0 x1876044512596224/t0(0) o3->5f7ef768-1508-4eda-9824-c10078b0a61e@192.168.206.35@tcp:229/0 lens 488/4536 e 0 to 0 dl 1789135809 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135798.986317:0:6685:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc3a2eb0c0 with x1876044512596224 ext(0->4095) 00002000:00010000:0.0:1789135798.986320:0:6685:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc3a2eb0c0 00010000:00010000:3.0:1789135798.988325:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135799.308498:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545089280:0@lo:400:kworker.0 00000100:00100000:1.0:1789135799.308566:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135799.308628:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135799.308635:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545089408:0@lo:400:kworker.0 00000100:00100000:1.0:1789135799.308661:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135799.308671:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545089024:0@lo:400:kworker.0 00000100:00100000:2.0:1789135799.308705:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135799.308726:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0315e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545089536:0@lo:400:kworker.0 00000100:00100000:2.0:1789135799.308766:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135799.308805:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135799.308811:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34e59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545089152:0@lo:400:kworker.0 00000100:00100000:2.0:1789135799.308834:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135799.308849:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0315cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545089664:0@lo:400:kworker.0 00000100:00100000:2.0:1789135799.308889:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.308929:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545089280 00000100:00100000:0.0:1789135799.308937:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545089280 00000100:00100000:0.0:1789135799.308991:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545089536 00000100:00100000:0.0:1789135799.308995:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545089536 00000100:00080000:2.0:1789135799.309001:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135799.309012:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545089152 00000100:00100000:0.0:1789135799.309014:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545089152 00000100:00100000:2.0:1789135799.309028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789135799.309086:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545089408 00000100:00100000:3.0:1789135799.309091:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545089408 00000100:00100000:3.0:1789135799.309122:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545089664 00000100:00100000:3.0:1789135799.309125:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545089664 00000100:00100000:3.0:1789135799.309146:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789135799.309157:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1876044545089408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135799.309212:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1876044545089408:12345-0@lo:400:kworker.0 Request processed in 59us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135799.309220:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789135799.309249:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789135799.309256:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3315:x1876044545089664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135799.309300:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3315:x1876044545089664:12345-0@lo:400:kworker.0 Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135799.309306:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789135799.309323:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545089024 00000100:00100000:3.0:1789135799.309327:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545089024 00000100:00100000:3.0:1789135799.309349:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789135799.309355:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545089024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135799.309382:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545089024:12345-0@lo:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135799.309387:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:3.0:1789135799.309413:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135799.309422:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135799.309449:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545089408:0@lo:400:kworker.0 00000100:00100000:3.0:1789135799.309477:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0315cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545089664:0@lo:400:kworker.0 00000100:00100000:3.0:1789135799.309486:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545089024:0@lo:400:kworker.0 00000100:00100000:2.0:1789135799.309546:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545089280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135799.310041:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545089280:12345-0@lo:400:kworker.0 Request processed in 1004us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.310831:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789135799.310851:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545089536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135799.310932:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545089536:12345-0@lo:400:kworker.0 Request processed in 90us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.310938:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789135799.310960:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789135799.310966:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545089152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135799.310998:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545089152:12345-0@lo:400:kworker.0 Request processed in 33us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.311003:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789135799.311302:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34e59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545089152:0@lo:400:kworker.0 00000100:00100000:0.0:1789135799.311315:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0315e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545089536:0@lo:400:kworker.0 00000100:00100000:0.0:1789135799.311374:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545089280:0@lo:400:kworker.0 00000100:00100000:2.0:1789135799.330504:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789135799.820722:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0315e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545089792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135799.820801:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.822460:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545089792 00000100:00100000:0.0:1789135799.822472:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545089792 00000100:00100000:0.0:1789135799.822522:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789135799.822533:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41908780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3313:x1876044545089792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135799.822564:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135799.826367:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0315e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545089792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135799.828366:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41908780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3313:x1876044545089792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5828us (7558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.828381:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000001:00080000:2.0:1789135799.890738:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1789135799.890754:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789135799.890759:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1789135800.016007:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135800.246991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135800.247040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135800.247092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135800.247114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135800.247138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135800.247167:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512596736 00000100:00100000:2.0:1789135800.247176:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512596736 00000100:00100000:2.0:1789135800.247228:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512596608 00000100:00100000:2.0:1789135800.247231:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512596608 00000100:00100000:2.0:1789135800.247253:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 102 00000100:00100000:2.0:1789135800.247261:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512596736:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135800.247327:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512596736:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.247335:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 102 00000100:00100000:2.0:1789135800.247350:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:2.0:1789135800.247356:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512596608:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135800.247426:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+8:2375:x1876044512596608:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 69us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.247432:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:2.0:1789135800.247453:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512596480 00000100:00100000:2.0:1789135800.247457:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512596480 00000100:00100000:2.0:1789135800.247483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512596864 00000100:00100000:2.0:1789135800.247485:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512596864 00000100:00100000:2.0:1789135800.247501:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 181 00000100:00100000:2.0:1789135800.247506:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+32:2376:x1876044512596480:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135800.247532:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+32:2376:x1876044512596480:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.247545:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 181 00000100:00100000:2.0:1789135800.247557:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 182 00000100:00100000:2.0:1789135800.247563:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2375:x1876044512596864:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135800.247585:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:2375:x1876044512596864:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 22us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.247590:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 182 00000100:00080000:2.0:1789135800.247603:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135800.247608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135800.247610:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135800.247961:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512596352 00000100:00100000:0.0:1789135800.247966:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512596352 00000100:00100000:0.0:1789135800.248034:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 331 00000100:00100000:0.0:1789135800.248041:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2375:x1876044512596352:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135800.248131:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2375:x1876044512596352:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 82us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135800.248138:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 331 00000100:00100000:3.0:1789135800.845164:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc4190bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545089920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135800.845230:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135800.845354:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545089920 00000100:00100000:2.0:1789135800.845362:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545089920 00000100:00100000:2.0:1789135800.845409:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789135800.845419:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3314:x1876044545089920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135800.845452:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135800.845505:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3314:x1876044545089920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.845512:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789135800.845593:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc4190bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545089920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789135801.038086:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135802.062009:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789135802.452948:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1789135802.452964:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1789135802.452969:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1789135802.463560:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:0.0:1789135802.463577:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adc05334840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789135802.463582:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc4131e000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adc05334300 00000020:00080000:0.0:1789135802.463586:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc4131e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc3403b400 00000020:00080000:0.0:1789135802.463599:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1789135802.463614:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1789135802.463634:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789135802.464371:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1789135803.084546:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135804.071492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135804.071601:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512596992 00000100:00100000:1.0:1789135804.071610:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512596992 00000100:00100000:1.0:1789135804.071695:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 238 00000100:00100000:1.0:1789135804.071706:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11567:x1876044512596992:12345-192.168.206.35@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789135804.071820:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11567:x1876044512596992:12345-192.168.206.35@tcp:60:lhsmtool_posix.0 Request processed in 116us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135804.071828:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 238 00000100:00080000:2.0:1789135804.071970:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135804.080222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135804.080918:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512597248 00000100:00100000:0.0:1789135804.080928:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512597248 00000100:00100000:0.0:1789135804.081002:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 65 00000100:00100000:0.0:1789135804.081013:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+19:11567:x1876044512597248:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789135804.081792:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+20:11567:x1876044512597248:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 777us (1576us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789135804.081801:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 65 00010000:00010000:3.0:1789135804.108879:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135804.302831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135804.303241:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512597376 00000100:00100000:2.0:1789135804.303262:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512597376 00000100:00100000:2.0:1789135804.303348:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 239 00000100:00100000:2.0:1789135804.303359:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+5:12357:x1876044512597376:12345-192.168.206.35@tcp:101:lsof.0 00010000:00010000:2.0:1789135804.303378:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135804.303411:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4f3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3908 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135804.303489:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4f44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135804.303502:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135804.303513:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135804.303699:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789135804.303704:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135804.303786:0:5836:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4f44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135804.304055:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3400/0x5b09da6ee1ce4f3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3908 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135804.304177:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4f44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3908 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135804.304185:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:2.0:1789135804.304188:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135804.304191:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3a00, rc 0) 00000100:00100000:2.0:1789135804.304311:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:12357:x1876044512597376:12345-192.168.206.35@tcp:101:lsof.0 Request processed in 954us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135804.304319:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 239 00000100:00080000:3.0:1789135804.307041:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135804.433694:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135804.433771:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135804.433792:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545090176:0@lo:400:kworker.0 00000100:00100000:0.0:1789135804.433871:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135804.434126:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545090176 00000100:00100000:2.0:1789135804.434145:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545090176 00000100:00100000:2.0:1789135804.434194:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789135804.434202:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545090176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135804.434253:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545090176:12345-0@lo:400:kworker.0 Request processed in 52us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135804.434260:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789135804.434355:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545090176:0@lo:400:kworker.0 00000100:00100000:1.0:1789135804.437109:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545090048:0@lo:400:kworker.0 00000100:00100000:1.0:1789135804.437186:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135804.437950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545090048 00000100:00100000:2.0:1789135804.437959:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545090048 00000100:00100000:2.0:1789135804.438013:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789135804.438023:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545090048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135804.438123:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+19:3316:x1876044545090048:12345-0@lo:400:kworker.0 Request processed in 101us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135804.438131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789135804.438975:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545090048:0@lo:400:kworker.0 00000100:00100000:0.0:1789135804.439449:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545090560:0@lo:400:kworker.0 00000100:00100000:0.0:1789135804.439499:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135804.439534:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135804.439540:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545090688:0@lo:400:kworker.0 00000100:00100000:0.0:1789135804.439566:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135804.439890:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545090304:0@lo:400:kworker.0 00000100:00100000:1.0:1789135804.439923:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135804.439955:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135804.439962:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545090432:0@lo:400:kworker.0 00000100:00100000:1.0:1789135804.439985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135804.440093:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545090560 00000100:00100000:0.0:1789135804.440100:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545090560 00000100:00100000:0.0:1789135804.440145:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545090304 00000100:00100000:0.0:1789135804.440148:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545090304 00000100:00100000:0.0:1789135804.440168:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789135804.440175:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0315cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545090560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135804.440221:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0315cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545090560:12345-0@lo:400:kworker.0 Request processed in 47us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135804.440241:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789135804.440256:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789135804.440261:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc4190bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545090304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135804.440292:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc4190bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545090304:12345-0@lo:400:kworker.0 Request processed in 31us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135804.440298:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789135804.440346:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545090304:0@lo:400:kworker.0 00000100:00100000:0.0:1789135804.440396:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545090560:0@lo:400:kworker.0 00000100:00100000:2.0:1789135804.440684:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545090688 00000100:00100000:2.0:1789135804.440689:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545090688 00000100:00100000:2.0:1789135804.440728:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545090432 00000100:00100000:2.0:1789135804.440731:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545090432 00000100:00100000:2.0:1789135804.440755:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789135804.440763:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc419503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135804.440806:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc419503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545090688:12345-0@lo:400:kworker.0 Request processed in 44us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135804.440813:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789135804.440826:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789135804.440833:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545090432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135804.440882:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545090432:12345-0@lo:400:kworker.0 Request processed in 50us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135804.440888:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789135804.440926:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789135804.440931:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc3a2fcb40, transno 4294967321 00000004:00080000:2.0:1789135804.440939:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc3a2fc000, transno 4294967322 00000004:00080000:2.0:1789135804.440943:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789135804.440961:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545090432:0@lo:400:kworker.0 00000100:00100000:2.0:1789135804.440984:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789135804.440988:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adb0319cf00, transno 4294967307 00000004:00080000:2.0:1789135804.440996:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789135804.441006:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc3a2eb840, transno 4294967310 00000100:00100000:2.0:1789135804.441010:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545090688:0@lo:400:kworker.0 00000100:00080000:1.0:1789135804.442275:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135804.442282:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135804.442284:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135804.940630:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545090816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135804.940710:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135804.940911:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545090816 00000100:00100000:0.0:1789135804.940918:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545090816 00000100:00100000:0.0:1789135804.940969:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789135804.940978:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545090816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135804.941010:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135804.941056:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545090816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135804.941082:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789135804.941173:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3787e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545090816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135805.134025:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135805.363800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135805.363856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135805.363893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135805.364052:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512597504 00000100:00100000:1.0:1789135805.364086:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512597504 00000100:00100000:1.0:1789135805.364136:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 333 00000100:00100000:1.0:1789135805.364146:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2375:x1876044512597504:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135805.364217:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2375:x1876044512597504:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 71us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135805.364225:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 333 00000100:00100000:1.0:1789135805.364282:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512597888 00000100:00100000:1.0:1789135805.364286:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512597888 00000100:00100000:1.0:1789135805.364316:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 106 00000100:00100000:1.0:1789135805.364323:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512597888:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135805.364349:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2375:x1876044512597888:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135805.364355:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 106 00000100:00080000:1.0:1789135805.364372:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135805.364753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135805.364802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135805.364884:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512597760 00000100:00100000:2.0:1789135805.364889:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512597760 00000100:00100000:2.0:1789135805.364934:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:2.0:1789135805.364941:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512597760:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135805.364986:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2375:x1876044512597760:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 46us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135805.364993:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:0.0:1789135805.365443:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512597632 00000100:00100000:0.0:1789135805.365448:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512597632 00000100:00100000:0.0:1789135805.365490:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512598016 00000100:00100000:0.0:1789135805.365493:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512598016 00000100:00100000:0.0:1789135805.365515:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 186 00000100:00100000:0.0:1789135805.365522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+20:2375:x1876044512597632:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135805.365567:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+20:2375:x1876044512597632:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 46us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.365574:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 186 00000100:00100000:0.0:1789135805.365691:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 187 00000100:00100000:0.0:1789135805.365699:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2375:x1876044512598016:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135805.365724:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2375:x1876044512598016:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 27us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.365730:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 187 00000100:00080000:3.0:1789135805.367850:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789135805.900340:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135805.900360:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135805.900414:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789135805.900421:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135805.964348:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135805.964373:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545090944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135805.964453:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.967120:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545090944 00000100:00100000:0.0:1789135805.967135:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545090944 00000100:00100000:0.0:1789135805.967201:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789135805.967212:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545090944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135805.967252:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789135805.967341:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545090944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.967348:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789135805.967404:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545090944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135806.156258:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135807.188921:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789135807.567774:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789135807.567791:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789135807.567811:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789135807.567829:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:1.0:1789135807.574180:0:13146:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:10:06 (1789135806) 00010000:00010000:0.0:1789135808.215543:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135809.228169:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135809.548316:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545091456:0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.548407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135809.548472:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135809.548478:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545091328:0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.548505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135809.548536:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545091456 00000100:00100000:3.0:1789135809.548542:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545091456 00000100:00100000:3.0:1789135809.548593:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789135809.548617:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545091456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.548667:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545091456:12345-0@lo:400:kworker.0 Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135809.548674:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789135809.548695:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545091328 00000100:00100000:3.0:1789135809.548699:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545091328 00000100:00100000:3.0:1789135809.548737:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789135809.548744:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545091328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.548773:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545091328:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135809.548780:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1789135809.548795:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135809.548800:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135809.548839:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545091072:0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.548840:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545091328:0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.548850:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545091456:0@lo:400:kworker.0 00000100:00100000:2.0:1789135809.548874:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.548896:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545091584:0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.548898:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545091072 00000100:00100000:3.0:1789135809.548901:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545091072 00000100:00100000:2.0:1789135809.548917:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135809.548924:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789135809.548930:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545091072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135809.548934:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135809.548939:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545091200:0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.548959:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545091072:12345-0@lo:400:kworker.0 Request processed in 29us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.548959:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135809.548965:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789135809.548973:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545091712:0@lo:400:kworker.0 00000100:00100000:2.0:1789135809.548993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.549016:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545091072:0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.549018:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545091712 00000100:00100000:3.0:1789135809.549021:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545091712 00000100:00100000:2.0:1789135809.549037:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545091584 00000100:00100000:2.0:1789135809.549040:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545091584 00000100:00100000:3.0:1789135809.549047:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789135809.549052:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545091712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135809.549059:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545091200 00000100:00100000:2.0:1789135809.549085:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545091200 00000100:00100000:2.0:1789135809.549105:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789135809.549110:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545091712:12345-0@lo:400:kworker.0 Request processed in 58us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.549110:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545091584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135809.549116:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789135809.549132:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135809.549134:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135809.549138:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545091584:12345-0@lo:400:kworker.0 Request processed in 28us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.549144:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789135809.549156:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789135809.549162:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545091200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135809.549186:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545091200:12345-0@lo:400:kworker.0 Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.549192:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789135809.549221:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545091200:0@lo:400:kworker.0 00000100:00100000:2.0:1789135809.549230:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545091712:0@lo:400:kworker.0 00000100:00100000:2.0:1789135809.549248:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545091584:0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.060425:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545091840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135810.060498:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135810.064695:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545091840 00000100:00100000:1.0:1789135810.064709:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545091840 00000100:00100000:1.0:1789135810.064776:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789135810.064786:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545091840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135810.064838:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135810.064945:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545091840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (4446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.064953:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789135810.065282:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545091840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789135810.253378:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135810.483462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135810.483508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135810.483541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135810.483572:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135810.483612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135810.483650:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512598528 00000100:00100000:3.0:1789135810.483659:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512598528 00000100:00100000:3.0:1789135810.483712:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512598400 00000100:00100000:3.0:1789135810.483716:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512598400 00000100:00100000:3.0:1789135810.483740:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 110 00000100:00100000:3.0:1789135810.483750:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512598528:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135810.483836:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2376:x1876044512598528:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.483844:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 110 00000100:00100000:3.0:1789135810.483861:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:3.0:1789135810.483868:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512598400:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135810.483894:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2376:x1876044512598400:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.483900:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 111 00000100:00100000:2.0:1789135810.483907:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512598144 00000100:00100000:2.0:1789135810.483912:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512598144 00000100:00100000:2.0:1789135810.483939:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 335 00000100:00100000:2.0:1789135810.483945:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512598144:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135810.483971:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2376:x1876044512598144:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.483977:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 335 00000100:00080000:2.0:1789135810.484017:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135810.484021:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135810.484032:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512598272 00000100:00100000:2.0:1789135810.484036:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512598272 00000100:00100000:2.0:1789135810.484104:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512598656 00000100:00100000:2.0:1789135810.484108:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512598656 00000100:00100000:2.0:1789135810.484129:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 191 00000100:00100000:2.0:1789135810.484136:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+19:2376:x1876044512598272:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135810.484175:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f7ef768-1508-4eda-9824-c10078b0a61e+19:2376:x1876044512598272:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 39us (723us total) trans 0 rc 0/0 00000100:00080000:3.0:1789135810.484234:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135810.485535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 192 00000100:00100000:0.0:1789135810.485558:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2376:x1876044512598656:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135810.485663:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2376:x1876044512598656:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 116us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.485671:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 192 00000100:00100000:2.0:1789135810.489545:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 191 00000100:00100000:3.0:1789135810.849933:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135810.850206:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512598912 00000100:00100000:1.0:1789135810.850215:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512598912 00000100:00100000:1.0:1789135810.850274:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:1.0:1789135810.850282:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+19:12578:x1876044512598912:12345-192.168.206.35@tcp:35:umount.0 00000100:00100000:1.0:1789135810.850998:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+20:12578:x1876044512598912:12345-192.168.206.35@tcp:35:umount.0 Request processed in 482us (839us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789135810.851008:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 66 00000100:00100000:0.0:1789135810.853678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135810.854015:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512599168 00000100:00100000:1.0:1789135810.854024:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512599168 00000100:00100000:1.0:1789135810.854112:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:1.0:1789135810.854122:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+20:12578:x1876044512599168:12345-192.168.206.35@tcp:35:umount.0 00000100:00100000:1.0:1789135810.854592:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+21:12578:x1876044512599168:12345-192.168.206.35@tcp:35:umount.0 Request processed in 469us (921us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789135810.854601:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 67 00000100:00100000:3.0:1789135810.856747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135810.856864:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512599424 00000100:00100000:0.0:1789135810.856873:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512599424 00000100:00100000:0.0:1789135810.856928:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:0.0:1789135810.856938:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc2904b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+21:12578:x1876044512599424:12345-192.168.206.35@tcp:35:umount.0 00000100:00100000:0.0:1789135810.857494:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc2904b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+22:12578:x1876044512599424:12345-192.168.206.35@tcp:35:umount.0 Request processed in 554us (752us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789135810.857503:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 68 00000100:00100000:3.0:1789135810.859853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135810.860095:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512599680 00000100:00100000:0.0:1789135810.860117:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512599680 00000100:00100000:0.0:1789135810.860165:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:0.0:1789135810.860281:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+22:12578:x1876044512599680:12345-192.168.206.35@tcp:35:umount.0 00000100:00100000:0.0:1789135810.860589:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f7ef768-1508-4eda-9824-c10078b0a61e+23:12578:x1876044512599680:12345-192.168.206.35@tcp:35:umount.0 Request processed in 310us (742us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789135810.870236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135810.870285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135810.870467:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512599936 00000100:00100000:1.0:1789135810.870476:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512599936 00000100:00100000:1.0:1789135810.870539:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512599808 00000100:00100000:1.0:1789135810.870542:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512599808 00000100:00100000:1.0:1789135810.870574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:1.0:1789135810.870583:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05776450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+14:2377:x1876044512599936:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135810.870597:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135810.870614:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01480600/0x5b09da6ee1ce3ee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d344d expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.870647:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135810.870699:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05776450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+13:2377:x1876044512599936:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 118us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.870707:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:1.0:1789135810.870777:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:1.0:1789135810.870783:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:2377:x1876044512599808:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135810.870792:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789135810.871511:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:1.0:1789135810.871606:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031a00/0x5b09da6ee1ce3f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3485 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.871621:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135810.871622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135810.871649:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512600192 00000100:00100000:3.0:1789135810.871654:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512600192 00000100:00100000:1.0:1789135810.871661:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c10fadf3-edc6-4c88-b194-561a01ca971d+12:2377:x1876044512599808:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 876us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.871670:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:3.0:1789135810.871695:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1789135810.871793:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512600064 00000100:00100000:2.0:1789135810.871798:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512600064 00000100:00100000:2.0:1789135810.871842:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 72 00000100:00100000:2.0:1789135810.871849:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+5:2374:x1876044512600064:12345-192.168.206.35@tcp:9:umount.0 00000020:00000080:2.0:1789135810.871884:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce4294 00000100:00080000:2.0:1789135810.871892:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8adc02b92800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789135810.871930:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789135810.872637:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c10fadf3-edc6-4c88-b194-561a01ca971d+11:2376:x1876044512600192:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135810.872652:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135810.872669:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34bab000/0x5b09da6ee1ce41a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d355e expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135810.872679:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135810.872716:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2376:x1876044512600192:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 1013us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.872966:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f7ef768-1508-4eda-9824-c10078b0a61e+2:2374:x1876044512600064:12345-192.168.206.35@tcp:9:umount.0 Request processed in 1115us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.872973:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 72 00010000:00010000:2.0:1789135810.873001:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135810.875053:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 69 00000100:00100000:3.0:1789135810.877897:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1789135810.878140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135810.878558:0:6765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512600576 00000100:00100000:1.0:1789135810.878567:0:6765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512600576 00000100:00100000:1.0:1789135810.878618:0:6765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:1.0:1789135810.878627:0:6765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+7:2374:x1876044512600576:12345-192.168.206.35@tcp:9:umount.0 00000020:00000080:1.0:1789135810.878655:0:6765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce44f5 00000020:00010000:1.0:1789135810.878664:0:6765:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8adc03e02800: total 0 00000100:00080000:1.0:1789135810.878669:0:6765:0:(import.c:65:import_set_state_nolock()) ffff8adc03e00800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135810.878709:0:6765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1789135810.878792:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8adc03e02800: total 0 00010000:00010000:2.0:1789135810.878839:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adc03e02800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789135810.878886:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5a596d/0x5b09da6ee1ce4898 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3733 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135810.878914:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce4f36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3901 expref: 5 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135810.878927:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adc03e02800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789135810.878937:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135810.878939:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135810.878941:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135810.879134:0:6765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+2:2374:x1876044512600576:12345-192.168.206.35@tcp:9:umount.0 Request processed in 506us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.879144:0:6765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 73 00000100:00100000:2.0:1789135810.902594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135810.902735:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512601600 00000100:00100000:3.0:1789135810.902744:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512601600 00000100:00100000:3.0:1789135810.902812:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 240 00000100:00100000:3.0:1789135810.902822:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+23:2374:x1876044512601600:12345-192.168.206.35@tcp:39:umount.0 00000020:00000080:3.0:1789135810.902852:0:7852:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3ef1 00000020:00010000:3.0:1789135810.902869:0:7852:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8adc41d47000: total 0 00000100:00080000:3.0:1789135810.902873:0:7852:0:(import.c:65:import_set_state_nolock()) ffff8adc03e06800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789135810.902907:0:7852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1789135810.903304:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f7ef768-1508-4eda-9824-c10078b0a61e+22:2374:x1876044512601600:12345-192.168.206.35@tcp:39:umount.0 Request processed in 482us (718us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789135810.903325:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 240 00000020:00010000:1.0:1789135810.905311:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8adc41d47000: total 0 00010000:00010000:1.0:1789135810.905371:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adc41d47000, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1789135810.905406:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:1.0:1789135810.905410:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135810.905421:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481600/0x5b09da6ee1ce48fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d374f expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905441:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc1953c900) 00010000:00010000:1.0:1789135810.905443:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135810.905447:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480800/0x5b09da6ee1ce4216 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3573 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905465:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135810.905467:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135810.905471:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ee00/0x5b09da6ee1ce4859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d371e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905484:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135810.905486:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789135810.905489:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2c00/0x5b09da6ee1ce4883 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d372c expref: 18 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905500:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135810.905503:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789135810.905506:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480c00/0x5b09da6ee1ce4ee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38ec expref: 17 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905516:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135810.905519:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789135810.905537:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce4f21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38fa expref: 16 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905551:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135810.905554:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135810.905558:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01480a00/0x5b09da6ee1ce4557 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d365a expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905570:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8adc1953cc00) 00010000:00010000:1.0:1789135810.905572:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135810.905575:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab800/0x5b09da6ee1ce41fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d356c expref: 14 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905589:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135810.905591:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135810.905595:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc42045400/0x5b09da6ee1ce4bf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3828 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905606:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135810.905608:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135810.905611:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc01481200/0x5b09da6ee1ce4e17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38b4 expref: 12 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905621:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8adc02cc5b00) 00010000:00010000:1.0:1789135810.905623:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135810.905626:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce4f13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d38f3 expref: 11 pid: 11758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905640:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8adc02cc5f00) 00010000:00010000:1.0:1789135810.905648:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789135810.905653:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e000/0x5b09da6ee1ce4916 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3756 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905679:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8adc1953c100) 00010000:00010000:1.0:1789135810.905681:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135810.905685:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce4779 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d36e6 expref: 9 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905700:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8adc1171a000) 00010000:00010000:1.0:1789135810.905702:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789135810.905706:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f2200/0x5b09da6ee1ce426a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3588 expref: 8 pid: 7852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.905719:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adc41d47000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1789135810.905731:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135810.905733:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135810.905735:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135811.084389:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545091968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135811.084458:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135811.084701:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545091968 00000100:00100000:1.0:1789135811.084710:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545091968 00000100:00100000:1.0:1789135811.084774:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789135811.084784:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34e59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545091968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135811.084831:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135811.084896:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34e59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545091968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135811.084904:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789135811.085026:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135811.085090:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545091968:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135811.276216:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135812.300254:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789135812.668587:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1789135812.668625:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000001:00080000:1.0:1789135812.668631:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1789135812.668647:0:5858:0:(genops.c:885:class_export_put()) final put ffff8adc41d47000/5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:1.0:1789135812.668670:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41d47000/5f7ef768-1508-4eda-9824-c10078b0a61e for lustre-MDT0000 00000020:00000080:1.0:1789135812.668724:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc03e06800 for lustre-MDT0000 00000001:00100000:1.0:1789135812.669317:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:1.0:1789135812.669322:0:6705:0:(genops.c:885:class_export_put()) final put ffff8adc03e02800/5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:3.0:1789135812.669377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc03e02800/5f7ef768-1508-4eda-9824-c10078b0a61e for lustre-OST0000 00000020:00000080:3.0:1789135812.669667:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc03e00800 for lustre-OST0000 00000100:00100000:2.0:1789135812.711351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135812.711394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135812.711439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135812.711717:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512601728 00000100:00100000:0.0:1789135812.711726:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512601728 00000100:00100000:0.0:1789135812.711784:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512601856 00000100:00100000:0.0:1789135812.711787:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512601856 00000100:00100000:0.0:1789135812.711815:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512601984 00000100:00100000:0.0:1789135812.711818:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512601984 00000100:00100000:0.0:1789135812.711834:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:0.0:1789135812.711843:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c10fadf3-edc6-4c88-b194-561a01ca971d+12:2378:x1876044512601728:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135812.711856:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135812.711884:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030200/0x5b09da6ee1ce3fc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d349a expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135812.711903:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135812.711961:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c10fadf3-edc6-4c88-b194-561a01ca971d+11:2378:x1876044512601728:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 119us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135812.711973:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:0.0:1789135812.711990:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:0.0:1789135812.711997:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c10fadf3-edc6-4c88-b194-561a01ca971d+10:2378:x1876044512601856:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135812.712004:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135812.712013:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e4a00/0x5b09da6ee1ce3fca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d34c4 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135812.712033:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135812.712052:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c10fadf3-edc6-4c88-b194-561a01ca971d+9:2378:x1876044512601856:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 56us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135812.712059:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:0.0:1789135812.712113:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:0.0:1789135812.712120:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c10fadf3-edc6-4c88-b194-561a01ca971d+8:2378:x1876044512601984:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135812.712127:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135812.712136:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34baba00/0x5b09da6ee1ce419f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3557 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135812.712144:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135812.712161:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c10fadf3-edc6-4c88-b194-561a01ca971d+7:2378:x1876044512601984:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 42us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135812.712167:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:2.0:1789135812.719612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135812.719820:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512602240 00000100:00100000:0.0:1789135812.719829:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512602240 00000100:00080000:3.0:1789135812.719976:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135812.720219:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 241 00000100:00100000:0.0:1789135812.720229:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d573bc19-f13c-42b5-94dc-b94e81618c9c+6:2374:x1876044512602240:12345-192.168.206.35@tcp:39:umount.0 00000020:00000080:0.0:1789135812.720267:0:11758:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3fd8 00000020:00010000:0.0:1789135812.720275:0:11758:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8adc34b9f800: total 0 00000100:00080000:0.0:1789135812.720279:0:11758:0:(import.c:65:import_set_state_nolock()) ffff8adc34b9c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789135812.720314:0:11758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1789135812.720482:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8adc34b9f800: total 0 00010000:00010000:3.0:1789135812.720486:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135812.720522:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adc34b9f800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789135812.720553:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1953c800) 00010000:00010000:3.0:1789135812.720557:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135812.720564:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc340f3a00/0x5b09da6ee1ce4f44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3908 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135812.720586:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adc34b9f800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789135812.720595:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135812.720597:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135812.720599:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135812.720694:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d573bc19-f13c-42b5-94dc-b94e81618c9c+3:2374:x1876044512602240:12345-192.168.206.35@tcp:39:umount.0 Request processed in 466us (1385us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789135812.720703:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 241 00000100:00100000:0.0:1789135812.739911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135812.740167:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512602496 00000100:00100000:3.0:1789135812.740177:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512602496 00000100:00100000:3.0:1789135812.740235:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 336 00000100:00100000:3.0:1789135812.740245:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+7:2374:x1876044512602496:12345-192.168.206.35@tcp:251:umount.0 00000020:00000080:3.0:1789135812.740289:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3ece 00000020:00010000:3.0:1789135812.740296:0:5831:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8adc41d45800: total 0 00000100:00080000:3.0:1789135812.740301:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8adc41d44800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789135812.740384:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c10fadf3-edc6-4c88-b194-561a01ca971d+3:2374:x1876044512602496:12345-192.168.206.35@tcp:251:umount.0 Request processed in 141us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135812.740406:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 336 00000020:00010000:0.0:1789135812.741227:0:6695:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8adc41d45800: total 0 00010000:00010000:0.0:1789135812.741274:0:6695:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adc41d45800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789135812.741307:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030400/0x5b09da6ee1ce3f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d348c expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135812.742381:0:6695:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adc41d45800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789135812.742407:0:6695:0:(genops.c:885:class_export_put()) final put ffff8adc41d45800/c10fadf3-edc6-4c88-b194-561a01ca971d 00010000:00010000:3.0:1789135812.742420:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135812.742422:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135812.742424:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789135812.742464:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41d45800/c10fadf3-edc6-4c88-b194-561a01ca971d for MGS 00000020:00000080:0.0:1789135812.742507:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc41d44800 for MGS 00010000:00010000:2.0:1789135813.324168:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789135814.346232:0:13343:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:2.0:1789135814.368033:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789135814.379228:0:13343:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789135814.379291:0:13343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.379305:0:13343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.379312:0:13343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.379318:0:13343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.379343:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789135814.379349:0:13343:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789135814.379371:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789135814.379375:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789135814.379380:0:13343:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789135814.379403:0:13343:0:(import.c:65:import_set_state_nolock()) ffff8adc392fc000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789135814.379468:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135814.379476:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135814.379483:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2e00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:0.0:1789135814.379487:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135814.379495:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135814.379502:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135814.379508:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789135814.379511:0:6695:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789135814.379513:0:6695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789135814.379541:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135814.379548:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135814.379575:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135814.379601:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2e00/0x5b09da6ee1ce3f53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f5a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135814.379613:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135814.379615:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135814.379616:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135814.379932:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545092224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135814.379995:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135814.380107:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545092096:0@lo:39:umount.0 00000100:00100000:3.0:1789135814.380144:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135814.380182:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545092096 00000100:00100000:3.0:1789135814.380188:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545092096 00000100:00100000:3.0:1789135814.380229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789135814.380238:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044545092096:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789135814.380261:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3cdd 00000100:00080000:3.0:1789135814.380281:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8adc41330800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789135814.380337:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545092224 00000100:00100000:0.0:1789135814.380342:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545092224 00000100:00100000:0.0:1789135814.380375:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789135814.380381:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545092224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135814.380391:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135814.380405:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb3600/0x5b09da6ee1ce3f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f53 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135814.380418:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135814.380454:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45dd8677-45c4-4169-a65f-287162436408+18:3315:x1876044545092224:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135814.380461:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135814.381801:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545092224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135814.381828:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135814.381969:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3312:x1876044545092096:12345-0@lo:39:umount.0 Request processed in 1731us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135814.381979:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1789135814.381988:0:5836:0:(genops.c:885:class_export_put()) final put ffff8adc41332800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789135814.382450:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41332800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789135814.382508:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc41330800 for lustre-MDT0000 00000100:00080000:1.0:1789135814.385337:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc392fc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789135814.385479:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545092096:0@lo:39:umount.0 00000100:00080000:3.0:1789135814.387613:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789135814.387621:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789135814.387628:0:13343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789135814.389538:0:13343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389556:0:13343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389564:0:13343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389571:0:13343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389589:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135814.389601:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135814.389607:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389613:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031e00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135814.389617:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389626:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135814.389640:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135814.389646:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789135814.389649:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789135814.389680:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389687:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135814.389706:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389714:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc00031e00/0x5b09da6ee1ce3f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389728:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135814.389729:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135814.389731:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135814.389739:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135814.389754:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545092352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135814.389831:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135814.389881:0:13343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389889:0:13343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389895:0:13343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389910:0:13343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389924:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135814.389931:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135814.389935:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389941:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480400 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135814.389944:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389951:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135814.389958:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135814.389963:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789135814.389965:0:6695:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789135814.389967:0:6695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789135814.389981:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.389986:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135814.389999:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.390006:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc01480400/0x5b09da6ee1ce3e88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3e8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.390023:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135814.390025:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135814.390026:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135814.390035:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545092480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135814.390079:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135814.390112:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545092352 00000100:00100000:2.0:1789135814.390119:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545092352 00000100:00100000:2.0:1789135814.390157:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545092480 00000100:00100000:2.0:1789135814.390160:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545092480 00000100:00100000:2.0:1789135814.390181:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789135814.390189:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05776850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+19:3315:x1876044545092352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135814.390202:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135814.390214:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e5000/0x5b09da6ee1ce3f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f61 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.390227:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135814.390260:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05776850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45dd8677-45c4-4169-a65f-287162436408+18:3315:x1876044545092352:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135814.390431:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135814.390441:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45dd8677-45c4-4169-a65f-287162436408+18:3313:x1876044545092480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135814.390450:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135814.390459:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01480000/0x5b09da6ee1ce3e8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3e88 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.390470:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135814.390502:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45dd8677-45c4-4169-a65f-287162436408+17:3313:x1876044545092480:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135814.390509:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135814.390542:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545092480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135814.393932:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789135814.394039:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545092352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135814.394095:0:13343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394108:0:13343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394116:0:13343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394138:0:13343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394161:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135814.394170:0:13343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394177:0:13343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394183:0:13343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394190:0:13343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394206:0:13343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789135814.394211:0:13343:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789135814.394215:0:13343:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789135814.394248:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789135814.394254:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394261:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baac00 already unused, calling callback (ffffffffc1a63c20) 00010000:00010000:3.0:1789135814.394418:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135814.394424:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.394437:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc029e4c00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135814.394440:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.394448:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135814.394455:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135814.394461:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789135814.394463:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789135814.394465:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789135814.394498:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.394505:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135814.394525:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.394532:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc029e4c00/0x5b09da6ee1ce3c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3c43 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.394549:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135814.394551:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135814.394553:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135814.394566:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adb0319d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545092608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135814.394618:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135814.394670:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545092608 00000100:00100000:3.0:1789135814.394683:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545092608 00000100:00100000:3.0:1789135814.394729:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789135814.394737:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+16:3314:x1876044545092608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135814.394749:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135814.394760:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2c00/0x5b09da6ee1ce3c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3c3c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135814.394775:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135814.394818:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45dd8677-45c4-4169-a65f-287162436408+15:3314:x1876044545092608:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135814.394824:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789135814.394858:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adb0319d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:45dd8677-45c4-4169-a65f-287162436408:3314:1876044545092608:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789135814.394902:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394911:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135814.394927:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135814.394932:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789135814.394934:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789135814.394936:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789135814.394950:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394955:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135814.394982:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.394990:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc34baac00/0x5b09da6ee1ce41c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce41d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135814.395000:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135814.395002:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135814.395003:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789135814.395017:0:13343:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789135814.395022:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789135814.395026:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135814.395031:0:13343:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789135814.395036:0:13343:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8adc41914000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789135814.395041:0:13343:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8adb01f6b000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789135814.395048:0:13343:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8adc34b9f800 d573bc19-f13c-42b5-94dc-b94e81618c9c 192.168.206.35@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789135814.395052:0:13343:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8adc35090000) has exports, disconnecting them 00000020:00080000:2.0:1789135814.395056:0:13343:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8adc41914000), last request at 1789135809 00000020:00000080:2.0:1789135814.395093:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3e50 00000100:00080000:2.0:1789135814.395108:0:13343:0:(import.c:65:import_set_state_nolock()) ffff8adc41915800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789135814.395141:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789135814.395152:0:13343:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc41914000): rc 0 00000020:00000080:2.0:1789135814.395154:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc41914000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:3.0:1789135814.395207:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545092736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135814.395235:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789135814.395520:0:13343:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8adb01f6b000), last request at 1789135809 00000020:00000080:2.0:1789135814.395525:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3d77 00000100:00080000:2.0:1789135814.395531:0:13343:0:(import.c:65:import_set_state_nolock()) ffff8adb01f6e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789135814.395546:0:13343:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adb01f6b000): rc 0 00000020:00000080:2.0:1789135814.395548:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adb01f6b000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789135814.395555:0:13343:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1f1c2a83ae0 00000100:00080000:2.0:1789135814.395573:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789135814.395576:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789135814.395587:0:13343:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789135814.395650:0:13343:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789135814.395663:0:13343:0:(import.c:65:import_set_state_nolock()) ffff8adc076d4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789135814.395676:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789135814.395678:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789135814.395689:0:13343:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789135814.395749:0:13343:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789135814.395758:0:13343:0:(import.c:65:import_set_state_nolock()) ffff8adc3929f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789135814.395801:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8adc35090000) has no exports 00010000:00010000:3.0:1789135814.396210:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789135814.396263:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41914000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789135814.396321:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adb01f6b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789135814.396345:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc41915800 for lustre-MDT0000 00000020:00000080:0.0:1789135814.396349:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adb01f6e800 for lustre-MDT0000 00000100:00100000:1.0:1789135814.396513:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545092736 00000100:00100000:1.0:1789135814.396520:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545092736 00000100:00100000:1.0:1789135814.396569:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135814.396579:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adb0319d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+15:3315:x1876044545092736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135814.396590:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135814.396604:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34bab400/0x5b09da6ee1ce41d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce41c9 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135814.396617:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135814.396678:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adb0319d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45dd8677-45c4-4169-a65f-287162436408+14:3315:x1876044545092736:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135814.396685:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135814.396712:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545092864:0@lo:9:umount.0 00000100:00100000:1.0:1789135814.396743:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135814.396767:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545092992:0@lo:9:umount.0 00000100:00100000:1.0:1789135814.396800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135814.396829:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545092864 00000100:00100000:1.0:1789135814.396833:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545092864 00000100:00100000:1.0:1789135814.396864:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545092992 00000100:00100000:1.0:1789135814.396876:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545092992 00000100:00100000:1.0:1789135814.396903:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135814.396909:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044545092864:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789135814.396929:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3dc4 00000100:00080000:1.0:1789135814.396935:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8adc05798000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135814.396961:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789135814.397388:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545092736:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789135814.397560:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135814.397565:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135814.397579:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789135814.397588:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876044545092992:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789135814.397611:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3eb9 00000100:00080000:0.0:1789135814.397617:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8adc41d64800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789135814.397650:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789135814.397777:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3312:x1876044545092992:12345-0@lo:9:umount.0 Request processed in 190us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135814.397794:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1789135814.397868:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135814.397918:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3312:x1876044545092864:12345-0@lo:9:umount.0 Request processed in 1008us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135814.397925:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1789135814.397950:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789135814.397970:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc076d4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789135814.397990:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789135814.397993:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789135814.397996:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545092864:0@lo:9:umount.0 00000100:00080000:1.0:1789135814.398008:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc3929f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789135814.398128:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789135814.402659:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789135814.402675:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545092992:0@lo:9:umount.0 00000020:00080000:1.0:1789135814.411539:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8adc35090000) has no exports 00000020:00000080:1.0:1789135814.481701:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c97 00000020:00000080:1.0:1789135814.481716:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3505a000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789135814.481740:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789135814.481766:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3505a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789135814.481817:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789135814.481828:0:13343:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789135814.481833:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8adc06b61a48) has no exports 00000020:00000080:0.0:1789135814.483498:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c90 00000020:00000080:0.0:1789135814.483510:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3ad2d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789135814.483579:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3ad2d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789135814.483591:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789135814.483601:0:13343:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789135814.483604:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3ad2e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789135814.483606:0:13343:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3ad2e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789135814.483615:0:13343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1789135814.668258:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545093120:0@lo:400:kworker.0 00000100:00100000:0.0:1789135814.668321:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135814.668345:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545093120 00000100:00100000:3.0:1789135814.668352:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545093120 00000100:00100000:3.0:1789135814.668396:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789135814.668404:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:3316:x1876044545093120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135814.668453:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45dd8677-45c4-4169-a65f-287162436408+14:3316:x1876044545093120:12345-0@lo:400:kworker.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135814.668461:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789135814.668492:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545093376:0@lo:400:kworker.0 00000100:00100000:3.0:1789135814.668529:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135814.668560:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545093248:0@lo:400:kworker.0 00000100:00100000:3.0:1789135814.668561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545093376 00000100:00100000:3.0:1789135814.668567:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545093376 00000100:00100000:1.0:1789135814.668596:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135814.668600:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789135814.668607:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1876044545093376:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789135814.668615:0:5837:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789135814.668635:0:11758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545093248 00000100:00100000:1.0:1789135814.668640:0:11758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545093248 00000100:00100000:3.0:1789135814.668655:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1876044545093376:12345-0@lo:400:kworker.0 Request processed in 46us (124us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789135814.668664:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789135814.668669:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3313:x1876044545093248:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789135814.668675:0:11758:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789135814.668722:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3313:x1876044545093248:12345-0@lo:400:kworker.0 Request processed in 50us (125us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789135814.668763:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545093120:0@lo:400:kworker.0 00000100:00080000:0.0:1789135814.668808:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789135814.668813:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8adc057f6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789135814.668817:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789135814.670310:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1789135814.670521:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789135814.670526:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8adc41911800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789135814.670530:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789135814.670534:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8adc41911800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789135814.670538:0:3314:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 231 00000100:00080000:2.0:1789135814.670559:0:3314:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc41911800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1789135814.670589:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3a2eb840 x1876044545093504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789135814.670624:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545093376:0@lo:400:kworker.0 00000100:00100000:3.0:1789135814.672329:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545093504:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789135814.672397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135814.672515:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545093504 00000100:00100000:2.0:1789135814.672522:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545093504 00000100:00100000:2.0:1789135814.672560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789135814.672566:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876044545093504:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789135814.672584:0:5836:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789135814.678356:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1789135814.689281:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8adc057f6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789135814.689290:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 208 00000100:00080000:0.0:1789135814.689299:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc057f6000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1789135814.689335:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3a354f00 x1876044545093632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789135814.689485:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545093248:0@lo:400:kworker.0 00000100:00100000:1.0:1789135814.689553:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044545093632:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789135814.689611:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135814.693187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545093632 00000100:00100000:0.0:1789135814.693201:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545093632 00000100:00100000:0.0:1789135814.693253:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789135814.693260:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1876044545093632:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789135814.693279:0:5837:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789135814.693369:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1876044545093632:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 98us (3746us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789135814.693377:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1789135814.693941:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc057f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789135814.693947:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789135814.693951:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044545093632:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789135814.712021:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876044545093504:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 39446us (39617us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789135814.712035:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1789135814.712326:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc41911800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789135814.712333:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789135814.712337:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545093504:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:2.0:1789135815.218987:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789135815.218996:0:7637:0:(genops.c:885:class_export_put()) final put ffff8adc41d67000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789135815.219036:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:2.0:1789135815.219039:0:7637:0:(genops.c:885:class_export_put()) final put ffff8adc02b93800/5f7ef768-1508-4eda-9824-c10078b0a61e 00000020:00000080:1.0:1789135815.219275:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41d67000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789135815.219323:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc02b93800/5f7ef768-1508-4eda-9824-c10078b0a61e for lustre-OST0001 00000020:00000080:1.0:1789135815.219343:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc41d64800 for lustre-OST0001 00000020:00000080:1.0:1789135815.219349:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc02b92800 for lustre-OST0001 00010000:00010000:3.0:1789135815.372403:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135816.398717:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135817.420728:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789135817.790785:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d573bc19-f13c-42b5-94dc-b94e81618c9c 00000001:00080000:3.0:1789135817.790801:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1789135817.790805:0:5858:0:(genops.c:885:class_export_put()) final put ffff8adc34b9f800/d573bc19-f13c-42b5-94dc-b94e81618c9c 00000020:00000080:3.0:1789135817.790827:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc34b9f800/d573bc19-f13c-42b5-94dc-b94e81618c9c for lustre-MDT0000 00000020:00000080:3.0:1789135817.790883:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc34b9c800 for lustre-MDT0000 00000001:00100000:2.0:1789135817.834908:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789135817.834917:0:6705:0:(genops.c:885:class_export_put()) final put ffff8adc0579d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789135817.834988:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc0579d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789135817.835038:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc05798000 for lustre-OST0000 00010000:00010000:3.0:1789135818.444348:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135819.468291:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789135819.790665:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789135819.790671:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789135819.790675:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adc057f6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789135819.790682:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 438 00000100:00080000:3.0:1789135819.790688:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789135819.790694:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc057f6000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135819.790717:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc34d661c0 x1876044545093888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789135819.790744:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789135819.790747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789135819.790748:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adc41911800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789135819.790763:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 438 00000100:00080000:3.0:1789135819.790766:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789135819.790771:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc41911800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135819.790785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc34d67c00 x1876044545094016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789135819.790790:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044545093888:0@lo:38:kworker.0 00000100:00100000:0.0:1789135819.790859:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.790924:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545094016:0@lo:38:kworker.0 00000100:00100000:0.0:1789135819.791146:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135819.791195:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545093760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135819.791215:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545093888 00000100:00100000:0.0:1789135819.791223:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545093888 00000100:00100000:2.0:1789135819.791239:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135819.791255:0:7852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545094016 00000100:00100000:0.0:1789135819.791259:0:7852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545094016 00000100:00100000:0.0:1789135819.791283:0:7852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789135819.791290:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545093760 00000100:00100000:0.0:1789135819.791291:0:7852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3312:x1876044545093888:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789135819.791297:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545093760 00010000:02000000:0.0:1789135819.791309:0:7852:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789135819.791337:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789135819.791346:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:3315:x1876044545093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135819.791393:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc11a67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45dd8677-45c4-4169-a65f-287162436408+14:3315:x1876044545093760:12345-0@lo:400:kworker.0 Request processed in 48us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135819.791406:0:11758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789135819.791417:0:11758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3312:x1876044545094016:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789135819.791418:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:02000000:1.0:1789135819.791430:0:11758:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789135819.791470:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:45dd8677-45c4-4169-a65f-287162436408:3315:1876044545093760:0@lo:400:kworker.0 00000100:00100000:1.0:1789135819.791479:0:11758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3312:x1876044545094016:12345-0@lo:38:kworker.0 Request processed in 62us (332us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789135819.791487:0:11758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:1.0:1789135819.791520:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc41911800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789135819.791525:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789135819.791528:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545094016:0@lo:38:kworker.0 00000100:00100000:0.0:1789135819.801838:0:7852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3312:x1876044545093888:12345-0@lo:38:kworker.0 Request processed in 10541us (10973us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789135819.801869:0:7852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1789135819.802205:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc057f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789135819.802211:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789135819.802222:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044545093888:0@lo:38:kworker.0 00010000:00010000:1.0:1789135820.495111:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789135820.556349:0:13343:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8adc07b7dba0 - data ffff8adc199e40d8/ffff8adc3a350800 00000020:01000000:0.0:1789135820.556542:0:13343:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8adc11f9df00 - data ffff8adc26bac360/ffff8adc04638400 00000001:00000004:0.0:1789135820.566402:0:13343:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789135820.628990:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789135820.628998:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789135820.629014:0:13343:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789135820.629017:0:13343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789135820.629595:0:6762:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789135820.629600:0:6762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789135820.629609:0:6762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789135820.630552:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789135820.630558:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789135820.630573:0:13343:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789135820.630575:0:13343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789135820.631180:0:7849:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789135820.631185:0:7849:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1789135820.631195:0:7849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789135820.676779:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c5f 00000020:00000080:2.0:1789135820.676914:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3509c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789135820.678294:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c74 00000020:00000080:2.0:1789135820.678304:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3509b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789135820.678310:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789135820.678319:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135820.678702:0:13343:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789135820.678708:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8adc35091a48) has no exports 00000004:01000000:2.0:1789135820.679214:0:13343:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789135820.679223:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3eb2 00000020:00000080:2.0:1789135820.679229:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc41d60800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789135820.679236:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789135820.679243:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135820.679250:0:13343:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789135820.679253:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8adb01d00000) has no exports 00000020:00000080:2.0:1789135820.679259:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3eab 00000020:00000080:2.0:1789135820.679263:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc39299000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789135820.679446:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3509c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789135820.679460:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3509b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1789135820.679464:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41d60800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789135820.679468:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc39299000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789135820.681173:0:13343:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789135820.681181:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789135820.681186:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1789135820.681209:0:13343:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789135820.681212:0:13343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789135820.681302:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789135820.681313:0:13343:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789135820.681321:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3dbd 00000020:00000080:2.0:1789135820.681397:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc07b85800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789135820.681948:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc3929f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789135820.681970:0:36:0:(genops.c:885:class_export_put()) final put ffff8adc3418e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789135820.681973:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3418e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789135820.681982:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789135820.682341:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789135820.682348:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135820.682356:0:13343:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789135820.682360:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8adc41701a48) has no exports 00000020:00000080:2.0:1789135820.682367:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3db6 00000020:00000080:2.0:1789135820.682372:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc076d5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789135820.682780:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc07b85800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789135820.682800:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc076d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789135820.683012:0:13343:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789135820.683017:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789135820.683020:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1789135820.683025:0:13343:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789135820.683027:0:13343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789135820.683096:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789135820.683103:0:13343:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789135820.683129:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789135820.683132:0:13343:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789135820.683136:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc392fe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789135820.683139:0:13343:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc392fe000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789135820.683147:0:13343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789135820.683278:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c7b 00000020:00000080:2.0:1789135820.683283:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3509a000/lustre-MDD0000_UUID 00000020:01000000:2.0:1789135820.683288:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789135820.683291:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135820.683295:0:13343:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789135820.683298:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8adc35094ed8) has no exports 00000020:00000080:2.0:1789135820.683319:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789135820.683322:0:13343:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789135820.683523:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc076d4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789135820.683537:0:36:0:(genops.c:885:class_export_put()) final put ffff8adc076d2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789135820.683539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc076d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789135820.683544:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789135820.683641:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3509a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789135820.683735:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3509c800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789135820.683737:0:13343:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3509c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789135820.683741:0:13343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1789135820.684040:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c82 00000020:00000080:2.0:1789135820.684046:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3509e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789135820.684269:0:13343:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc10b30000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789135820.684274:0:13343:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc10b30000 3 00000020:01000004:2.0:1789135820.684276:0:13343:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adc10b30000 from lustre-MDT0000 00000020:00000080:2.0:1789135820.684298:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789135820.684304:0:13343:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789135820.684307:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc3509d000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789135820.684310:0:13343:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3509d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789135820.684316:0:13343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789135820.684410:0:13343:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789135820.684414:0:13343:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789135820.684418:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789135820.684421:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135820.684424:0:13343:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789135820.684430:0:13343:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8adc11261800 45dd8677-45c4-4169-a65f-287162436408 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789135820.684437:0:13343:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8adc04f23490) has exports, disconnecting them 00000020:00080000:2.0:1789135820.684441:0:13343:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8adc11261800), last request at 1789135566 00000020:00000080:2.0:1789135820.684455:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c20 00000020:00010000:2.0:1789135820.684459:0:13343:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8adc11261800: total 1 00000100:00080000:2.0:1789135820.684463:0:13343:0:(import.c:65:import_set_state_nolock()) ffff8adc11265000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789135820.684523:0:13343:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc11261800): rc 0 00000020:00080000:2.0:1789135820.684527:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8adc04f23490) has no exports 00000100:00100000:2.0:1789135820.684571:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8adc04eab800:5832] 2 exiting: rc = 0 00000100:00100000:2.0:1789135820.684712:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8adc04eaa000:5830] 0 exiting: rc = 1 00000100:00100000:3.0:1789135820.684905:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8adc04ea8000:5831] 1 exiting: rc = 0 00000020:00000080:3.0:1789135820.684943:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc3509e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1789135820.685358:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685366:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685371:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685387:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685392:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685398:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685403:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685410:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685415:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685421:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685426:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685432:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685437:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685444:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685449:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685457:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685463:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685470:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685475:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685481:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685486:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685491:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685497:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685502:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685507:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685513:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685519:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685524:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685529:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685534:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685540:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685545:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685551:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685556:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685561:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685565:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685570:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685575:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685585:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685590:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685596:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685601:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685606:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685612:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685617:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685721:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685728:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685734:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685739:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685744:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685758:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685763:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685768:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685773:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685778:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685783:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685795:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685801:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685806:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685812:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685818:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685823:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685828:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.685834:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789135820.686417:0:13343:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789135820.686421:0:13343:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:1.0:1789135820.687239:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8adc11261800: total 0 00010000:00010000:1.0:1789135820.687282:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adc11261800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789135820.687308:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc340f2e00/0x5b09da6ee1ce41c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce41bb expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135820.687324:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb3c00/0x5b09da6ee1ce3f22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f1b expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135820.687345:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34baa800/0x5b09da6ee1ce3f30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f29 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135820.687355:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34babe00/0x5b09da6ee1ce3f3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f37 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135820.687364:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc13fb2800/0x5b09da6ee1ce3f4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f45 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135820.687373:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc34bab600/0x5b09da6ee1ce41b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce41ad expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135820.687385:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce3d2a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3d23 expref: 3 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135820.687396:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc029e4400/0x5b09da6ee1ce3f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b09da6ee1ce3f6f expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135820.687407:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adc11261800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789135820.687417:0:5825:0:(genops.c:885:class_export_put()) final put ffff8adc11261800/45dd8677-45c4-4169-a65f-287162436408 00010000:00010000:1.0:1789135820.687436:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135820.687445:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135820.687447:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789135820.687533:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc11261800/45dd8677-45c4-4169-a65f-287162436408 for MGS 00000020:00000080:2.0:1789135820.687565:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc11265000 for MGS 00000020:01000000:2.0:1789135820.688737:0:13343:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8adc07b7dd80 - data ffff8adc0fea05e8/ffff8adc3a353400 00000020:01000000:2.0:1789135820.688884:0:13343:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8adc07d71a80 - data ffff8adc0873be58/ffff8adc07d9b800 00000020:00000080:2.0:1789135820.689760:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c04 00000020:00000080:2.0:1789135820.689769:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc299c9800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789135820.689863:0:13343:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc10b30000 from MGS, refs=2 00000020:01000004:2.0:1789135820.689867:0:13343:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc10b30000 2 00000020:01000004:2.0:1789135820.689870:0:13343:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adc10b30000 from MGS 00000020:00000080:2.0:1789135820.689892:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789135820.689898:0:13343:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789135820.689901:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc299cc000/MGS 00000020:00000080:2.0:1789135820.689904:0:13343:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc299cc000/MGS for MGS 00000020:01000000:2.0:1789135820.689910:0:13343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1789135820.690187:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc299c9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789135820.690242:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789135820.690247:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135820.690253:0:13343:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789135820.690260:0:13343:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8adc392ff000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789135820.690266:0:13343:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8adc35093490) has exports, disconnecting them 00000020:00080000:2.0:1789135820.690271:0:13343:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8adc392ff000), last request at 1789135567 00000020:00000080:2.0:1789135820.690275:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3ccf 00000020:00080000:2.0:1789135820.690285:0:13343:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc392ff000): rc 0 00000020:00000080:2.0:1789135820.690289:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc392ff000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789135820.691351:0:13343:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789135820.691358:0:13343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789135820.691362:0:13343:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789135820.691368:0:13343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789135820.691922:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc392ff000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789135820.692264:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789135820.692271:0:13343:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789135820.692278:0:13343:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc10b30000 1 00000020:00000080:3.0:1789135820.692283:0:13343:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3bf6 00000020:00000080:3.0:1789135820.692290:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc299cd000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789135820.692296:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789135820.692300:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789135820.692303:0:13343:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789135820.692305:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8adc06b60000) has no exports 00000020:00000080:1.0:1789135820.692983:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc392fc000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789135820.692993:0:8:0:(genops.c:885:class_export_put()) final put ffff8adc35098000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789135820.692996:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc35098000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789135820.693002:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789135820.693087:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc299cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789135820.713298:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789135820.713312:0:13343:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789135820.713318:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc07efe800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789135820.713323:0:13343:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc07efe800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789135820.713342:0:13343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789135820.713455:0:13343:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adc10b30800 00000020:01000000:3.0:1789135820.713474:0:13343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789135820.713478:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789135820.713483:0:13343:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789135820.713486:0:13343:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8adc06b63490) has no exports 00000100:00100000:0.0:1789135820.713975:0:7852:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8adb02eb9600:7852] 3 exiting: rc = 0 00000100:00100000:2.0:1789135820.713976:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8adc11b49000:5836] 0 exiting: rc = 1 00000100:00100000:1.0:1789135820.718181:0:11758:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8adc07ac0600:11758] 4 exiting: rc = 0 00000100:00100000:1.0:1789135820.718519:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8adc11acf000:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1789135820.718571:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8adc11b48a00:5838] 2 exiting: rc = 0 00000100:00100000:3.0:1789135820.718781:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718799:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718824:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718830:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718835:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718840:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718845:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718850:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718855:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718859:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718867:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718871:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718876:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718881:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718886:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718891:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718896:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718901:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718905:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718910:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718915:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718919:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718924:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718929:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718934:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718938:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718943:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.718947:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719171:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719178:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719184:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719190:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719196:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719203:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719213:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719218:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719226:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719237:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719242:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719352:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719361:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719366:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719370:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719375:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719379:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719384:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719389:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719394:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719400:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719404:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719410:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719416:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719421:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719425:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719431:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719436:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719441:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719447:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719453:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719459:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719464:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719469:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719475:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.719480:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.726834:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8adc11afb800:5839] 0 exiting: rc = 1 00000100:00100000:1.0:1789135820.726871:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8adc11b48400:5840] 1 exiting: rc = 0 00000100:00100000:3.0:1789135820.727157:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727165:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727172:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727177:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727182:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727187:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727193:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727199:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727218:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727224:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727229:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727234:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727239:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727244:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727248:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727252:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727256:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727261:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727267:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727271:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727275:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727280:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727285:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727289:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727293:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727298:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727302:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727307:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727311:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727316:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727320:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727391:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727401:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727406:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727411:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727416:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727420:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727424:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727429:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727433:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727438:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727443:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727448:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727461:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727466:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727471:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727476:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727481:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727486:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727491:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727496:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727501:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727505:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727511:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727516:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727521:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727525:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727530:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727535:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727540:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727544:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727549:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727554:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.727559:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789135820.728917:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8adc11284c00:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1789135820.729193:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8adc05db2800:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1789135820.729298:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729307:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729313:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729319:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729324:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729330:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729336:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729342:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729347:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729353:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729358:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729364:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729385:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729402:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729408:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729413:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729418:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729423:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729429:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729435:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729440:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729504:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729512:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729518:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729537:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729544:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729550:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729555:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729564:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729572:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729578:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729583:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729591:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729596:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729602:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729607:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729629:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729636:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729642:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729647:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729653:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729659:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729665:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729671:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729678:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729683:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729694:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729701:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729728:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729859:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729866:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729873:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729879:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729885:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729895:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729902:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729907:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729912:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729918:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729923:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729943:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729952:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729959:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.729965:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.739541:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8adc05db2400:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1789135820.740493:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8adc11b0c000:5844] 1 exiting: rc = 0 00000100:00100000:3.0:1789135820.740637:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740645:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740650:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740655:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740660:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740665:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740671:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740676:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740681:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740686:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740691:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740695:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740715:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740720:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740725:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740730:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740797:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740802:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740807:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740812:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740820:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740824:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740829:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740834:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740839:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740853:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740858:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740863:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740868:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740872:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740877:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740883:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740888:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740893:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740898:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740902:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740907:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740914:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740919:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740924:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740929:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740934:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740939:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740944:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740948:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740954:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740959:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740972:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740976:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740981:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740987:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740992:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.740997:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741002:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741007:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741011:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741016:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741020:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741025:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741030:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741263:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741272:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741277:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.741282:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789135820.741866:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8adc11b0d600:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1789135820.742028:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8adc11b0c800:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1789135820.742146:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742152:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742157:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742162:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742166:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742171:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742176:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742182:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742187:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742192:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742197:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742202:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742207:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742212:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742216:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742221:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742227:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742232:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742248:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742253:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742257:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742262:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742267:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742272:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742277:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742281:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742286:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742292:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742296:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742301:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742305:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742310:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742314:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742319:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742324:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742328:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742333:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742338:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742344:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742349:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742353:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742358:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742363:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742367:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742373:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742378:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742383:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742388:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742393:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742398:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742412:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742418:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742423:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742437:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742441:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742445:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742449:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742454:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742458:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742463:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742467:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742472:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742478:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.742482:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.742975:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8adc391afe00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1789135820.743115:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8adc391ae600:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1789135820.743313:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743319:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743324:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743329:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743334:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743339:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743344:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743349:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743353:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743357:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743362:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743368:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743373:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743377:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743383:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743388:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743393:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743398:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743491:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743498:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743503:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743507:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743512:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743517:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743530:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743534:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743539:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743543:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743547:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743552:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743556:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743560:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743564:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743568:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743573:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743577:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743581:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743586:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743590:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743595:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743599:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743603:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743607:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743611:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743616:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743620:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743625:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743631:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743635:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743640:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743644:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743649:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743654:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743660:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743666:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743673:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743678:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743683:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743689:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743705:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743712:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743720:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743725:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.743742:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135820.744783:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8adc39217c00:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1789135820.745159:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8adc39217200:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789135820.745816:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8adc11b0cc00:5851] 2 exiting: rc = 0 00000100:00100000:3.0:1789135820.745963:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.745970:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.745976:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.745981:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.745987:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.745993:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746000:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746005:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746011:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746016:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746022:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746028:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746046:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746197:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746204:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746209:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746216:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746221:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746227:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746232:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746238:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746246:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746252:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746258:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746263:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746268:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746273:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746281:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746287:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746312:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746319:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746328:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746334:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746339:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746345:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746352:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746357:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746380:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746387:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746394:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746399:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746476:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746487:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746493:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746499:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746505:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746512:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746517:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746523:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746528:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746534:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746540:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746546:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746552:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746558:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746563:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746569:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746575:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746580:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746586:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746591:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746598:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746604:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789135820.746610:0:13343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789135820.754704:0:13343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789135820.754717:0:13343:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789135820.754723:0:13343:0:(genops.c:885:class_export_put()) final put ffff8adc04fba000/MDS_uuid 00000020:00000080:2.0:1789135820.754727:0:13343:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc04fba000/MDS_uuid for MDS 00000020:01000000:2.0:1789135820.754735:0:13343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789135820.755014:0:13343:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789135821.518486:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135822.541397:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789135823.459767:0:13498:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789135823.480684:0:13498:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789135823.480728:0:13498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.480752:0:13498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.480759:0:13498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.480782:0:13498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.480857:0:13498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789135823.480863:0:13498:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789135823.480883:0:13498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789135823.480887:0:13498:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789135823.480892:0:13498:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789135823.480898:0:13498:0:(import.c:65:import_set_state_nolock()) ffff8adc057f6000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789135823.480902:0:13498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789135823.480904:0:13498:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789135823.480907:0:13498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789135823.482287:0:13498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.482306:0:13498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.482314:0:13498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.482321:0:13498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.484169:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135823.484183:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.484194:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baa600 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135823.484198:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.484207:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135823.484214:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135823.484220:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789135823.484222:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789135823.484226:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789135823.484268:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.484389:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789135823.484448:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545094144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135823.484466:0:13498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135823.484480:0:13498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.484489:0:13498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.484498:0:13498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135823.484505:0:13498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135823.484515:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135823.484552:0:13498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789135823.484557:0:13498:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789135823.484586:0:13498:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789135823.484589:0:13498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789135823.484594:0:13498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789135823.484600:0:13498:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789135823.484604:0:13498:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8adb01d03490) has no exports 00010000:00010000:1.0:1789135823.484616:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135823.484623:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484642:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb3000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135823.484645:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484652:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135823.484657:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135823.484662:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789135823.484665:0:6695:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789135823.484673:0:6695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789135823.484691:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484698:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135823.484718:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484723:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb3000/0x5b09da6ee1ce3f45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484749:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135823.484752:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484757:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fa00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135823.484760:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484766:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135823.484772:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135823.484777:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789135823.484779:0:6695:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789135823.484781:0:6695:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789135823.484796:0:6695:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484802:0:6695:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135823.484815:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484821:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fa00/0x5b09da6ee1ce41bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce41c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135823.484831:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135823.484833:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135823.484837:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135823.484845:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789135823.484850:0:13498:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8adb01d03490) has no exports 00000100:00100000:1.0:1789135823.484857:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545094272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135823.484886:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.484909:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135823.484916:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545094400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135823.484936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135823.484969:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545094144 00000100:00100000:1.0:1789135823.484976:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545094144 00000100:00100000:1.0:1789135823.485012:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545094272 00000100:00100000:1.0:1789135823.485015:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545094272 00000100:00100000:1.0:1789135823.485029:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545094400 00000100:00100000:1.0:1789135823.485031:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545094400 00000100:00100000:1.0:1789135823.485044:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135823.485051:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3316:x1876044545094144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789135823.485058:0:5823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789135823 with bad export cookie 6560014502011485216 00000020:01000000:0.0:1789135823.486936:0:13498:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8adc13720d80 - data ffff8adc0fe99288/ffff8adc3a3a8c00 00000020:01000000:0.0:1789135823.487161:0:13498:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8adc13720540 - data ffff8adc26bfaa20/ffff8adb01fccc00 00010000:00010000:3.0:1789135823.488246:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.488261:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc34baa600/0x5b09da6ee1ce3f37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b09da6ee1ce3f3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135823.488286:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135823.488288:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135823.488290:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135823.488316:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789135823.488339:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1876044545094272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789135823.488346:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789135823 with bad export cookie 6560014502011485216 00000100:00100000:3.0:1789135823.488421:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1876044545094272:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (3534us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789135823.488428:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789135823.488457:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135823.488461:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1876044545094400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789135823.488465:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789135823 with bad export cookie 6560014502011485216 00000100:00100000:3.0:1789135823.488485:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1876044545094400:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (3549us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789135823.488490:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789135823.488531:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789135823.488535:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8adc04fb8000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789135823.488539:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1789135823.493640:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3316:x1876044545094144:12345-0@lo:103:ldlm_bl.0 Request processed in 8583us (9121us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789135823.493652:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789135823.495665:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789135823.508961:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.135@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789135823.508967:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789135823.508976:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc34d65680 x1876044545094144/t0(0) o103->MGC192.168.206.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789135839 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135823.508991:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc3496fc00 x1876044545094272/t0(0) o103->MGC192.168.206.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789135839 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135823.509000:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc3496cb40 x1876044545094400/t0(0) o103->MGC192.168.206.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789135839 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789135823.509009:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789135823.509012:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789135823.509013:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789135823.509843:0:3316:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8adc04fb8000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789135823.509868:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:45dd8677-45c4-4169-a65f-287162436408:3316:1876044545094144:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789135823.510014:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8adc04fb8000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789135823.510022:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.206.135@tcp: connect to NID 0@lo last attempt 190 00000100:00080000:3.0:1789135823.510048:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.206.135@tcp: import ffff8adc04fb8000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135823.511828:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc34d66580 x1876044545094528/t0(0) o250->MGC192.168.206.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135823.511879:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545094272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135823.511900:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:45dd8677-45c4-4169-a65f-287162436408:3313:1876044545094400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135823.511992:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:45dd8677-45c4-4169-a65f-287162436408:3312:1876044545094528:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1789135823.512040:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044545094528 offset 0 length 520: 4 00100000:10000000:0.0:1789135823.523566:0:13498:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:1.0:1789135823.568822:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789135823.584672:0:13498:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3d46 00000020:00000080:1.0:1789135823.584682:0:13498:0:(genops.c:885:class_export_put()) final put ffff8adc39298800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789135823.584703:0:13498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc057f3800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789135823.584707:0:13498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc057f3800 2 00000020:01000004:1.0:1789135823.584710:0:13498:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adc057f3800 from lustre-OST0000 00000020:00000080:1.0:1789135823.584744:0:13498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789135823.584754:0:13498:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789135823.584756:0:13498:0:(genops.c:885:class_export_put()) final put ffff8adc10b36000/lustre-OST0000_UUID 00000020:00000080:1.0:1789135823.584759:0:13498:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc10b36000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789135823.584765:0:13498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789135823.584810:0:13498:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789135823.584814:0:13498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789135823.584817:0:13498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789135823.584822:0:13498:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789135823.584828:0:13498:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8adb01f6f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789135823.584834:0:13498:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8adc04788000) has exports, disconnecting them 00000020:00080000:1.0:1789135823.584838:0:13498:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8adb01f6f800), last request at 1789135584 00000020:00000080:1.0:1789135823.584842:0:13498:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3d70 00000020:00080000:1.0:1789135823.584853:0:13498:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adb01f6f800): rc 0 00000020:00000080:1.0:1789135823.584858:0:13498:0:(genops.c:885:class_export_put()) final put ffff8adb01f6f800/lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789135823.585477:0:13498:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789135823.585483:0:13498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789135823.585488:0:13498:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789135823.585493:0:13498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789135823.585621:0:13498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789135823.585627:0:13498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789135823.585632:0:13498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc057f3800 1 00000020:00000080:1.0:1789135823.585637:0:13498:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3d00 00000020:00000080:1.0:1789135823.585642:0:13498:0:(genops.c:885:class_export_put()) final put ffff8adc34a23000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789135823.585657:0:13498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789135823.585660:0:13498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789135823.585663:0:13498:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789135823.585667:0:13498:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8adc04789a48) has no exports 00000020:00000080:3.0:1789135823.586861:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc39298800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789135823.586874:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adb01f6f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789135823.586880:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc057f6000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789135823.586897:0:8:0:(genops.c:885:class_export_put()) final put ffff8adb01c81800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789135823.586900:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adb01c81800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789135823.586905:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789135823.586954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc34a23000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789135823.659539:0:13498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789135823.659556:0:13498:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789135823.659562:0:13498:0:(genops.c:885:class_export_put()) final put ffff8adc057f6800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789135823.659567:0:13498:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc057f6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789135823.659579:0:13498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789135823.660447:0:13498:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adc057f3000 00000020:02000400:0.0:1789135823.660491:0:13498:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789135824.591416:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789135824.908750:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 45dd8677-45c4-4169-a65f-287162436408->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789135824.908760:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 45dd8677-45c4-4169-a65f-287162436408->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789135824.908763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789135824.908766:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789135824.908770:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adc41911800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789135824.908779:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 443 00000100:00080000:1.0:1789135824.908785:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789135824.908792:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc41911800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1789135824.908830:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3496f480 x1876044545094656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135824.908911:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545094656:0@lo:38:kworker.0 00000400:00000100:3.0:1789135824.908966:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044545094656 offset 0 length 520: 4 00010000:00010000:2.0:1789135825.613478:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789135826.335410:0:13648:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789135826.352774:0:13648:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789135826.352841:0:13648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.352854:0:13648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.352862:0:13648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.352868:0:13648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.352888:0:13648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789135826.352894:0:13648:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789135826.352917:0:13648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789135826.352928:0:13648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc3496f480 x1876044545094656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789135844 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135826.352953:0:13648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789135826.352959:0:13648:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789135826.352965:0:13648:0:(import.c:65:import_set_state_nolock()) ffff8adc41911800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789135826.352970:0:13648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1789135826.353103:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135826.353110:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135826.353118:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baae00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:3.0:1789135826.353121:0:6695:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135826.353130:0:6695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135826.353138:0:6695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135826.353154:0:6695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789135826.353157:0:6695:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789135826.353159:0:6695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789135826.353172:0:6695:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adc04fb8000 00010000:00010000:3.0:1789135826.353175:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135826.353181:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc34baae00/0x5b09da6ee1ce3f1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b09da6ee1ce3f22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135826.353191:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135826.353193:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135826.353195:0:6695:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135826.353446:0:13648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc3496f480 x1876044545094656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789135844 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135826.353454:0:13648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789135826.353692:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545094656:0@lo:38:kworker.0 00000100:00100000:2.0:1789135826.354381:0:13648:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789135826.356727:0:13648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.356763:0:13648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.356770:0:13648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.356777:0:13648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.356861:0:13648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135826.356869:0:13648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.356876:0:13648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.356882:0:13648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135826.356889:0:13648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135826.356965:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135826.357042:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135826.357050:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030000 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135826.357054:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135826.357123:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135826.357132:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135826.357150:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789135826.357152:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789135826.357164:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adc04fb8000 00010000:00010000:1.0:1789135826.357168:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135826.357175:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc00030000/0x5b09da6ee1ce3f29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b09da6ee1ce3f30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135826.357189:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135826.357192:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135826.357198:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fe00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135826.357201:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135826.357207:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135826.357213:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135826.357218:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789135826.357220:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789135826.357223:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adc04fb8000 00010000:00010000:1.0:1789135826.357226:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135826.357242:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135826.357243:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135826.357245:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135826.357388:0:13648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789135826.357393:0:13648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc3a31fe00/0x5b09da6ee1ce41ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b09da6ee1ce41b4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135826.357407:0:13648:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789135826.357412:0:13648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1789135826.357415:0:13648:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789135826.357443:0:13648:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789135826.357448:0:13648:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789135826.357453:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135826.357458:0:13648:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789135826.357462:0:13648:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8adc0478ced8) has no exports 00000020:00080000:2.0:1789135826.357647:0:13648:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8adc0478ced8) has no exports 00010000:00010000:3.0:1789135826.359176:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789135826.359966:0:13648:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8adc13720c60 - data ffff8adc3f95a000/ffff8adb017c9c00 00000020:01000000:3.0:1789135826.360631:0:13648:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8adc340cf120 - data ffff8adc26bff948/ffff8adb038f4000 00100000:10000000:2.0:1789135826.385649:0:13648:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789135826.518516:0:13648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3e1f 00000020:00000080:0.0:1789135826.518525:0:13648:0:(genops.c:885:class_export_put()) final put ffff8adc03f40800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789135826.518548:0:13648:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adb01c80000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789135826.518552:0:13648:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adb01c80000 2 00000020:01000004:0.0:1789135826.518555:0:13648:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adb01c80000 from lustre-OST0001 00000020:00000080:0.0:1789135826.518579:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789135826.518588:0:13648:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789135826.518591:0:13648:0:(genops.c:885:class_export_put()) final put ffff8adc03f44000/lustre-OST0001_UUID 00000020:00000080:0.0:1789135826.518594:0:13648:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc03f44000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789135826.518600:0:13648:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789135826.518762:0:13648:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 45dd8677-45c4-4169-a65f-287162436408->MGS 00010000:00010000:0.0:1789135826.518776:0:13648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2400/0x5b09da6ee1ce3d23 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3d2a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135826.518788:0:13648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2400/0x5b09da6ee1ce3d23 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3d2a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135826.518795:0:13648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789135826.518798:0:13648:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789135826.518802:0:13648:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789135826.518815:0:13648:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adc04fb8000 00010000:00010000:0.0:1789135826.518819:0:13648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2400/0x5b09da6ee1ce3d23 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b09da6ee1ce3d2a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135826.518835:0:13648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b09da6ee1ce3f76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135826.518841:0:13648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b09da6ee1ce3f76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135826.518846:0:13648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789135826.518849:0:13648:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789135826.518850:0:13648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789135826.518859:0:13648:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8adc04fb8000 00010000:00010000:0.0:1789135826.518862:0:13648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2000/0x5b09da6ee1ce3f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b09da6ee1ce3f76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789135826.518876:0:13648:0:(import.c:65:import_set_state_nolock()) ffff8adc04fb8000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789135826.518879:0:13648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789135826.518881:0:13648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789135826.518883:0:13648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789135826.518887:0:13648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789135826.518904:0:13648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc34d66580 x1876044545094528/t0(0) o250->MGC192.168.206.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789135833 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789135826.518930:0:13648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789135826.518934:0:13648:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1789135826.518996:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc03f40800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1789135826.519097:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:45dd8677-45c4-4169-a65f-287162436408:3312:1876044545094528:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1789135826.520734:0:13648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789135826.520748:0:13648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3c12 00000020:00000080:0.0:1789135826.520757:0:13648:0:(genops.c:885:class_export_put()) final put ffff8adc04fbb800/45dd8677-45c4-4169-a65f-287162436408 00000020:01000000:0.0:1789135826.520766:0:13648:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.135@tcp (flags='') 00000020:00000080:0.0:1789135826.520772:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789135826.520778:0:13648:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.135@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789135826.520782:0:13648:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8adc06b64ed8) has no exports 00000020:00000080:1.0:1789135826.520857:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc04fbb800/45dd8677-45c4-4169-a65f-287162436408 for MGC192.168.206.135@tcp 10000000:01000000:2.0:1789135826.531602:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789135826.531738:0:13648:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.135@tcp: client import never connected 00000100:00080000:0.0:1789135826.531744:0:13648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789135826.531748:0:13648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789135826.531751:0:13648:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789135826.531754:0:13648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789135826.531823:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789135826.531832:0:13648:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.135@tcp (uuid 45dd8677-45c4-4169-a65f-287162436408) 00000020:01000000:0.0:1789135826.531839:0:13648:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789135826.531843:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789135826.531848:0:13648:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789135826.531856:0:13648:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8adc03f43000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1789135826.531857:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc04fb8000 for MGC192.168.206.135@tcp 00000020:00080000:0.0:1789135826.531862:0:13648:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8adc0478b490) has exports, disconnecting them 00000020:00000080:1.0:1789135826.531866:0:36:0:(genops.c:885:class_export_put()) final put ffff8adc04fbe000/45dd8677-45c4-4169-a65f-287162436408 00000020:00080000:0.0:1789135826.531866:0:13648:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8adc03f43000), last request at 1789135608 00000020:00000080:1.0:1789135826.531869:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc04fbe000/45dd8677-45c4-4169-a65f-287162436408 for MGC192.168.206.135@tcp 00000020:01000000:1.0:1789135826.531875:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.135@tcp (45dd8677-45c4-4169-a65f-287162436408) 00000020:00000080:0.0:1789135826.531884:0:13648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3e49 00000020:00080000:0.0:1789135826.531897:0:13648:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc03f43000): rc 0 00000020:00000080:0.0:1789135826.531901:0:13648:0:(genops.c:885:class_export_put()) final put ffff8adc03f43000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789135826.549901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc03f43000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789135826.551112:0:13648:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789135826.551119:0:13648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789135826.551123:0:13648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789135826.551130:0:13648:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789135826.551214:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8adc41911800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789135826.561322:0:6695:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789135826.561555:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789135826.561724:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789135826.561964:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8adc10a5c800:5820] 0 exiting: rc = 1 00000100:00100000:2.0:1789135826.562024:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8adc10a5c000:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1789135826.562140:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.562621:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8adc10a5d800:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1789135826.566189:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8adc07d9e200:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1789135826.566437:0:8443:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8adc0469a800:8443] 3 exiting: rc = 0 00000100:00100000:2.0:1789135826.569253:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8adc07d9fe00:5824] 2 exiting: rc = 0 00000100:00100000:0.0:1789135826.569407:0:8444:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8adc04eea600:8444] 4 exiting: rc = 0 00000100:00100000:2.0:1789135826.569755:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569764:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569769:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569777:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569782:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569788:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569794:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569800:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569806:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569811:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569817:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569822:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569839:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569844:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569850:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569856:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569861:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569867:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569872:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569877:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569882:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569887:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569892:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569897:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569902:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569908:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569913:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569918:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569923:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569928:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569934:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569938:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569944:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569948:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569952:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569957:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569963:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.569967:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570043:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570048:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570053:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570057:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570086:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570091:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570096:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570101:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570105:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570117:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570122:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570126:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570132:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570137:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570143:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570148:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570152:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570159:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570164:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570170:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570175:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570180:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570185:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570189:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570193:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.570198:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789135826.574172:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789135826.574184:0:13648:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789135826.574190:0:13648:0:(genops.c:885:class_export_put()) final put ffff8adc41917800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789135826.574195:0:13648:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc41917800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789135826.574200:0:13648:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789135826.574259:0:13648:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adb01c80000 1 00000020:00000080:2.0:1789135826.574264:0:13648:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b09da6ee1ce3dee 00000020:00000080:2.0:1789135826.574270:0:13648:0:(genops.c:885:class_export_put()) final put ffff8adb01f6d000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789135826.574282:0:13648:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789135826.574442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adb01f6d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789135826.574455:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789135826.574460:0:13648:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789135826.574463:0:13648:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8adb01d01a48) has no exports 00000020:00000080:0.0:1789135826.614243:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789135826.614258:0:13648:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789135826.614264:0:13648:0:(genops.c:885:class_export_put()) final put ffff8adb01c82000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789135826.614268:0:13648:0:(genops.c:844:class_export_destroy()) destroying export ffff8adb01c82000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789135826.614277:0:13648:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789135826.614638:0:13648:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adb01c87800 00000020:01000000:0.0:1789135826.614663:0:13648:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789135826.614668:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789135826.614671:0:13648:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789135826.614675:0:13648:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8adc41703490) has no exports 00000020:00000080:0.0:1789135826.614705:0:13648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789135826.614724:0:13648:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789135826.614727:0:13648:0:(genops.c:885:class_export_put()) final put ffff8adc34a22800/OSS_uuid 00000020:00000080:0.0:1789135826.614730:0:13648:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc34a22800/OSS_uuid for OSS 00000020:01000000:0.0:1789135826.614734:0:13648:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789135826.614762:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789135826.620170:0:6765:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8adb01fcba00:6765] 3 exiting: rc = 0 00000100:00100000:0.0:1789135826.620273:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8adc12c76000:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1789135826.620339:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8adc0479a000:6681] 1 exiting: rc = 0 00000100:00100000:1.0:1789135826.623785:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8adc12c76800:6682] 2 exiting: rc = 0 00000100:00100000:0.0:1789135826.623870:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623881:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623893:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623901:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623906:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623911:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623916:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623921:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623926:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623931:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623935:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623953:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623957:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623961:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623965:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623981:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623987:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623992:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.623996:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624001:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624006:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624010:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624015:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624020:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624025:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624030:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624034:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624038:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624042:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624047:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624051:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624056:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624089:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624096:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624101:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624106:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624111:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624117:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624123:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624127:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624132:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624137:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624142:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624147:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624152:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624157:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624170:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624176:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624181:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624186:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624190:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624195:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624200:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624205:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624210:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624215:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624220:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624226:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624230:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624235:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624241:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624246:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624251:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.624262:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789135826.646597:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8adc34818c00:6683] 0 exiting: rc = 1 00000100:00100000:0.0:1789135826.647275:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8adc34819400:6684] 1 exiting: rc = 0 00000100:00100000:2.0:1789135826.651856:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651869:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651874:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651894:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651899:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651905:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651910:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651916:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651922:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651927:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651933:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651938:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651942:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651946:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651951:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651956:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651961:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651966:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651984:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651991:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.651997:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652003:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652008:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652014:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652020:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652025:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652031:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652036:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652042:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652047:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652052:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652058:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652089:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652095:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652100:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652105:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652110:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652114:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652126:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652131:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652135:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652141:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652146:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652151:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652156:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652161:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652166:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652171:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652176:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652182:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652187:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652193:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652198:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652203:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652209:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652214:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652219:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652225:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652230:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652235:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652239:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652244:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652249:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.652255:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789135826.657468:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8adc34818600:6687] 2 exiting: rc = 0 00000100:00100000:0.0:1789135826.657883:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8adc413cf600:6685] 0 exiting: rc = 1 00000100:00100000:1.0:1789135826.658983:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8adc0479a200:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1789135826.663498:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663522:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663528:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663534:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663541:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663546:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663568:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663578:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663597:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663621:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663628:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663635:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663642:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663647:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663654:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663670:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663677:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663684:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663691:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663698:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663704:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663711:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663731:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663737:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663743:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663748:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663754:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663761:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663767:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663772:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663779:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663786:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663791:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663797:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663803:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663809:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663814:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663820:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663826:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663848:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663856:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663862:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663868:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663874:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663886:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663892:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663897:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663903:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663909:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663918:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663924:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663931:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663936:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663942:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663949:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663955:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663960:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.663966:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.665096:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.665111:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.665118:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.665123:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.665129:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.665135:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682099:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8adc413cfc00:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1789135826.682511:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8adc1363ba00:6688] 0 exiting: rc = 1 00000100:00100000:2.0:1789135826.682683:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682690:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682696:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682701:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682706:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682710:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682728:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682733:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682737:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682742:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682746:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682751:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682756:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682761:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682780:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682785:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682790:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682795:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682800:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682806:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682811:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682815:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682820:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682824:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682829:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682833:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682837:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682841:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682845:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682850:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682856:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682860:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682864:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682869:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682875:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682879:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682884:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682889:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682894:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682902:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682907:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682911:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682916:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682921:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682925:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682930:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682936:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682941:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682945:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682957:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682962:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682967:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682971:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682986:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682991:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.682997:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.683002:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.683007:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.683011:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.683016:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.683022:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.683027:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.683032:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.683037:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.689375:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8adc34819c00:6691] 1 exiting: rc = 0 00000100:00100000:0.0:1789135826.689404:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8adc076af000:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1789135826.690294:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690303:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690309:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690314:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690320:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690326:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690332:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690338:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690344:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690350:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690356:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690361:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690385:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690392:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690397:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690403:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690408:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690414:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690420:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690443:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690449:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690455:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690461:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690468:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690488:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690495:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690511:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690517:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690522:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690528:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690533:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690538:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690544:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690550:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690556:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.690561:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691863:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691880:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691886:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691892:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691899:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691905:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691911:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691917:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691923:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691929:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691935:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691941:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.691966:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692049:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692055:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692080:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692087:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692092:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692109:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692121:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692127:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692133:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692139:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692144:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692167:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692175:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692180:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789135826.692187:0:13648:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789135826.713349:0:13648:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789135842.327589:0:14263:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789135849.626623:0:14724:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789135849.626628:0:14724:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789135849.626739:0:14724:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adc1a4e1800 00000020:01000004:3.0:1789135849.626753:0:14724:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789135849.626759:0:14724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789135849.626771:0:14724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8adc41701a48) 00000020:00000080:3.0:1789135849.626782:0:14724:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789135849.643217:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789135849.645473:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789135849.645907:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 357: rc = 0 00100000:10000000:2.0:1789135849.645994:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 357: rc = 0 00100000:10000000:2.0:1789135849.646186:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 357: rc = 0 00100000:10000000:2.0:1789135849.646282:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 357: rc = 0 00100000:10000000:2.0:1789135849.646383:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 357: rc = 0 00100000:10000000:2.0:1789135849.646730:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789135849.646802:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 357: rc = 0 00100000:10000000:2.0:1789135849.647043:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 359: rc = 0 00100000:10000000:2.0:1789135849.648354:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 643: rc = 0 00100000:10000000:2.0:1789135849.648621:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 643: rc = 0 00100000:10000000:2.0:1789135849.649014:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 646: rc = 0 00100000:10000000:2.0:1789135849.649370:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 646: rc = 0 00100000:10000000:2.0:1789135849.649796:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 646: rc = 0 00100000:10000000:2.0:1789135849.650041:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 646: rc = 0 00100000:10000000:2.0:1789135849.650390:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 646: rc = 0 00100000:10000000:2.0:1789135849.650790:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 646: rc = 0 00100000:10000000:2.0:1789135849.651042:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:2.0:1789135849.651319:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1789135849.651725:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 646: rc = 0 00100000:10000000:2.0:1789135849.651962:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 646: rc = 0 00100000:10000000:2.0:1789135849.652326:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 646: rc = 0 00100000:10000000:2.0:1789135849.652992:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1789135849.653940:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 662: rc = 0 00100000:10000000:2.0:1789135849.654244:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 662: rc = 0 00100000:10000000:2.0:1789135849.654503:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 662: rc = 0 00100000:10000000:2.0:1789135849.654754:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 662: rc = 0 00100000:10000000:2.0:1789135849.654997:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 662: rc = 0 00100000:10000000:2.0:1789135849.655583:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 662: rc = 0 00100000:10000000:2.0:1789135849.655845:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 662: rc = 0 00100000:10000000:2.0:1789135849.656170:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 662: rc = 0 00100000:10000000:2.0:1789135849.656483:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 662: rc = 0 00100000:10000000:2.0:1789135849.656814:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 662: rc = 0 00100000:10000000:2.0:1789135849.657032:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 662: rc = 0 00100000:10000000:2.0:1789135849.658025:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 662: rc = 0 00100000:10000000:2.0:1789135849.658289:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 662: rc = 0 00100000:10000000:2.0:1789135849.658601:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 662: rc = 0 00100000:10000000:2.0:1789135849.658818:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 662: rc = 0 00100000:10000000:2.0:1789135849.659049:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 662: rc = 0 00100000:10000000:2.0:1789135849.659662:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 662: rc = 0 00100000:10000000:2.0:1789135849.659934:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 662: rc = 0 00100000:10000000:2.0:1789135849.660332:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 662: rc = 0 00100000:10000000:2.0:1789135849.660757:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 662: rc = 0 00100000:10000000:2.0:1789135849.661113:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 662: rc = 0 00100000:10000000:2.0:1789135849.661999:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 662: rc = 0 00100000:10000000:2.0:1789135849.662660:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 662: rc = 0 00100000:10000000:2.0:1789135849.663031:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 662: rc = 0 00100000:10000000:2.0:1789135849.664294:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 662: rc = 0 00100000:10000000:2.0:1789135849.664786:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 662: rc = 0 00100000:10000000:2.0:1789135849.665269:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 662: rc = 0 00100000:10000000:2.0:1789135849.665749:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 662: rc = 0 00100000:10000000:2.0:1789135849.666115:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 662: rc = 0 00100000:10000000:2.0:1789135849.666749:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 662: rc = 0 00100000:10000000:2.0:1789135849.667685:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 662: rc = 0 00100000:10000000:2.0:1789135849.668008:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 662: rc = 0 00100000:10000000:2.0:1789135849.668880:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 190: rc = 0 00100000:10000000:2.0:1789135849.669893:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789135849.670282:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 625: rc = 0 00100000:10000000:2.0:1789135849.670718:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789135849.670866:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 625: rc = 0 00100000:10000000:2.0:1789135849.671094:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789135849.671301:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 625: rc = 0 00100000:10000000:2.0:1789135849.671960:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789135849.672035:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:2.0:1789135849.672683:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789135849.672756:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:2.0:1789135849.673018:0:14724:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789135849.673113:0:14724:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00000020:00000080:2.0:1789135849.673718:0:14724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789135849.673726:0:14724:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789135849.673743:0:14724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce4f52 00000020:01000004:2.0:1789135849.673751:0:14724:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789135849.673756:0:14724:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789135849.673761:0:14724:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adc1a4e1800 from MGS 00000020:01000004:2.0:1789135849.673765:0:14724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789135849.673774:0:14724:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8adc04f23490) 00000020:00000080:2.0:1789135849.673783:0:14724:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789135849.673917:0:14724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc1a4e1800 from MGS, refs=2 00080000:01000000:2.0:1789135849.673923:0:14724:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789135849.673928:0:14724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce4f60 00000100:00100000:2.0:1789135849.674021:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789135849.674441:0:14724:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789135849.674448:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789135849.675167:0:14724:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789135849.675175:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789135849.680144:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135849.680339:0:14724:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789135849.680346:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789135849.681167:0:14724:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789135849.681174:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789135849.683139:0:14724:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789135849.683151:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789135849.686746:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135849.686751:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135849.686753:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135849.696275:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135849.696280:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135849.696283:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135849.696969:0:14724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789135849.698270:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789135849.712810:0:14724:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789135849.712829:0:14724:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789135849.712831:0:14724:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789135849.714504:0:14733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789135849.714654:0:14724:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789135849.714755:0:14724:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789135849.715260:0:14724:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789135849.715542:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135849.715708:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789135849.715713:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789135849.719359:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789135849.719373:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789135849.720310:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789135849.720318:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789135849.721437:0:14724:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789135849.721464:0:14724:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.135@tcp' 00000020:01000004:2.0:1789135849.721466:0:14724:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789135849.721505:0:14724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.135@tcp (typ=mgc) 00000020:00000080:2.0:1789135849.721518:0:14724:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.135@tcp (ffff8adc04f21a48) 00000020:00000080:2.0:1789135849.721534:0:14724:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789135849.721625:0:14724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adb0391b000@MGC192.168.206.135@tcp: add connection 192.168.206.135@tcp at head 00010000:00010000:2.0:1789135849.721800:0:14724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.135@tcp-0 is initialized 00000040:01000000:2.0:1789135849.721808:0:14724:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789135849.722115:0:14739:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789135849.722139:0:14724:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.135@tcp (uuid 6499b41b-f800-46b7-9637-f4c3e1cfbd8f) 00000020:00000080:2.0:1789135849.722153:0:14724:0:(genops.c:1385:class_connect()) connect: client 6499b41b-f800-46b7-9637-f4c3e1cfbd8f, cookie 0x5b09da6ee1ce4f6e 00000100:00080000:2.0:1789135849.722163:0:14724:0:(import.c:510:import_select_connection()) MGC192.168.206.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135849.722168:0:14724:0:(import.c:624:import_select_connection()) MGC192.168.206.135@tcp: import ffff8adb0391b000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1789135849.722198:0:14724:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3a2e8b40 x1876044545094784/t0(0) o250->MGC192.168.206.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135849.722219:0:14724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6499b41b-f800-46b7-9637-f4c3e1cfbd8f->MGS 00000020:01000004:2.0:1789135849.722237:0:14724:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789135849.722242:0:14724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789135849.722251:0:14724:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8adc04f20000) 00000020:00000080:2.0:1789135849.722261:0:14724:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1789135849.724211:0:14738:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1789135849.728822:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3312:1876044545094784:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789135849.728921:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135849.729128:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545094784 00000100:00100000:0.0:1789135849.729144:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545094784 00000100:00100000:0.0:1789135849.729191:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135849.729199:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1876044545094784:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789135849.729237:0:14734:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 6499b41b-f800-46b7-9637-f4c3e1cfbd8f@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:0.0:1789135849.729279:0:14734:0:(genops.c:1385:class_connect()) connect: client 6499b41b-f800-46b7-9637-f4c3e1cfbd8f, cookie 0x5b09da6ee1ce4f7c 00000100:00080000:0.0:1789135849.729418:0:14734:0:(import.c:65:import_set_state_nolock()) ffff8adc1a4e1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135849.729481:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+5:3312:x1876044545094784:12345-0@lo:250:mount.lustre.0 Request processed in 281us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135849.729489:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135849.729576:0:3312:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789135849.729585:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.135@tcp: connect to target with instance 0 00000100:00080000:3.0:1789135849.729731:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789135849.729735:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789135849.729738:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adb0391b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789135849.729740:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789135849.729781:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789135849.729787:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3312:1876044545094784:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789135849.731493:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135849.731761:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789135849.731769:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789135849.735661:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789135849.735673:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789135849.741921:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789135849.741936:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789135849.742677:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135849.742929:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789135849.742935:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789135849.744509:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789135849.744518:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789135849.795333:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135849.795529:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789135849.795535:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789135849.796835:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789135849.796847:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789135849.797816:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135849.798000:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135849.798005:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789135849.798885:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789135849.798892:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789135849.799731:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135849.799877:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135849.799882:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789135849.800685:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789135849.800694:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789135849.805276:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135849.805475:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135849.805482:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789135849.806438:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789135849.806446:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789135849.826387:0:14724:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135849.826606:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789135849.826614:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789135849.833861:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789135849.838162:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789135849.847548:0:14724:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789135849.847563:0:14724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789135849.848704:0:14724:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789135849.848728:0:14724:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789135849.848734:0:14724:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789135849.848871:0:14724:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789135849.848903:0:14724:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.135@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789135849.848908:0:14724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789135849.848909:0:14724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789135849.848910:0:14724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135849.848912:0:14724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135849.848913:0:14724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135849.848914:0:14724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135849.848915:0:14724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789135849.848917:0:14724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789135849.848918:0:14724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135849.848919:0:14724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135849.848922:0:14724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789135849.848924:0:14724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789135849.848930:0:14724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789135849.848931:0:14724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135849.848932:0:14724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135849.848933:0:14724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135849.848934:0:14724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135849.848935:0:14724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789135849.848936:0:14724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789135849.848937:0:14724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135849.848938:0:14724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135849.848963:0:14724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789135849.848982:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ced680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545094912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789135849.849052:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135849.849184:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1328a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135849.849311:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545094912 00000100:00100000:1.0:1789135849.849319:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545094912 00000100:00100000:1.0:1789135849.849396:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135849.849406:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+5:14724:x1876044545094912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789135849.849450:0:14737:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789135849.849453:0:14737:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789135849.849456:0:14737:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789135849.849741:0:14758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789135849.850048:0:14737:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789135849.850860:0:14759:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789135849.850866:0:14759:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789135849.850868:0:14759:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789135849.850904:0:14759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789135849.851150:0:14737:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789135849.851159:0:14737:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789135849.857278:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+5:14724:x1876044545094912:12345-0@lo:253:mount.lustre.0 Request processed in 7867us (8218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135849.857292:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135849.857436:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ced680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545094912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789135849.857452:0:14724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789135849.857456:0:14724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789135849.857457:0:14724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789135849.857458:0:14724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135849.857460:0:14724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135849.857461:0:14724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135849.857462:0:14724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135849.857463:0:14724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789135849.857465:0:14724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789135849.857466:0:14724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135849.857468:0:14724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789135849.857489:0:14724:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adc1a4e1800 from lustre-MDT0000 10000000:01000000:0.0:1789135849.857519:0:14724:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789135849.857522:0:14724:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789135849.857526:0:14724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8adc04f21a48 10000000:01000000:0.0:1789135849.857531:0:14724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789135849.857538:0:14724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adc04f21a48 from 1 10000000:01000000:0.0:1789135849.857540:0:14724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789135849.857574:0:14724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135849.857613:0:14724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135849.857623:0:14724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135849.857643:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ced680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789135849.857679:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135849.857717:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1328a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135849.857778:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545095040 00000100:00100000:1.0:1789135849.857785:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545095040 00000100:00100000:1.0:1789135849.857827:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135849.857845:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+5:14724:x1876044545095040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789135849.857859:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135849.857873:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce4f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce4f83 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135849.857893:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce4f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4f83 expref: 6 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135849.857903:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01481c00/0x5b09da6ee1ce4f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4f83 expref: 6 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135849.857911:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481c00, rc 0) 00000100:00100000:1.0:1789135849.858046:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+6:14724:x1876044545095040:12345-0@lo:101:mount.lustre.0 Request processed in 202us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135849.858053:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789135849.858295:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ced680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135849.858308:0:14724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.858317:0:14724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135849.858363:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135849.858399:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.858466:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135849.858503:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545095168 00000100:00100000:1.0:1789135849.858508:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545095168 00000100:00100000:1.0:1789135849.858568:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135849.858576:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+6:14724:x1876044545095168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789135849.858829:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+6:14724:x1876044545095168:12345-0@lo:501:mount.lustre.0 Request processed in 253us (428us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135849.858837:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135849.858908:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095168:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789135849.858930:0:14724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789135849.858988:0:14724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.858997:0:14724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135849.859005:0:14724:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adc1a4e1800 10000000:01000000:2.0:1789135849.859010:0:14724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789135849.859015:0:14724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8adc1a4e1800 10000000:01000000:2.0:1789135849.859018:0:14724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789135849.859020:0:14724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8adc1a4e1800 from 1 10000000:01000000:2.0:1789135849.859023:0:14724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789135849.859044:0:14724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f2e00/0x5b09da6ee1ce4f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.859051:0:14724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc340f2e00/0x5b09da6ee1ce4f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.859059:0:14724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc340f2e00/0x5b09da6ee1ce4f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135849.859101:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789135849.859131:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.859152:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135849.859285:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545095296 00000100:00100000:3.0:1789135849.859291:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545095296 00000100:00100000:3.0:1789135849.859319:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135849.859327:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+6:14724:x1876044545095296:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789135849.859336:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135849.859349:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce4f91 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135849.859363:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4f91 expref: 7 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135849.859372:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31fc00/0x5b09da6ee1ce4f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4f91 expref: 7 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135849.859379:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31fc00, rc 0) 00000100:00100000:3.0:1789135849.859419:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+7:14724:x1876044545095296:12345-0@lo:101:mount.lustre.0 Request processed in 93us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135849.859425:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135849.859493:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135849.859512:0:14724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc340f2e00/0x5b09da6ee1ce4f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f98 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.859521:0:14724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc340f2e00/0x5b09da6ee1ce4f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce4f98 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135849.859532:0:14724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789135849.859752:0:14724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f2e00/0x5b09da6ee1ce4f91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f98 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.859760:0:14724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc340f2e00/0x5b09da6ee1ce4f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f98 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135849.859766:0:14724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789135849.859770:0:14724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135849.859774:0:14724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8adc1a4e1800 10000000:01000000:2.0:1789135849.859776:0:14724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789135849.859779:0:14724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789135849.859782:0:14724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789135849.859797:0:14724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f2000/0x5b09da6ee1ce4f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.859804:0:14724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc340f2000/0x5b09da6ee1ce4f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.859810:0:14724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc340f2000/0x5b09da6ee1ce4f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135849.859823:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789135849.859862:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.859892:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135849.859941:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545095424 00000100:00100000:3.0:1789135849.859952:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545095424 00000100:00100000:3.0:1789135849.859986:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135849.859992:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+7:14724:x1876044545095424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789135849.860000:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135849.860008:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31f400/0x5b09da6ee1ce4fa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce4f9f expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135849.860022:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31f400/0x5b09da6ee1ce4fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4f9f expref: 8 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135849.860030:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31f400/0x5b09da6ee1ce4fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce4f9f expref: 8 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135849.860036:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f400, rc 0) 00000100:00100000:3.0:1789135849.860099:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+8:14724:x1876044545095424:12345-0@lo:101:mount.lustre.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135849.860105:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135849.860271:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135849.860282:0:14724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc340f2000/0x5b09da6ee1ce4f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4fa6 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.860290:0:14724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc340f2000/0x5b09da6ee1ce4f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce4fa6 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135849.860333:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135849.860361:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.860386:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135849.860438:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545095552 00000100:00100000:1.0:1789135849.860442:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545095552 00000100:00100000:1.0:1789135849.860474:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135849.860481:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+8:14724:x1876044545095552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789135849.860837:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+9:14724:x1876044545095552:12345-0@lo:501:mount.lustre.0 Request processed in 356us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135849.860853:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789135849.860940:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135849.860968:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789135849.861008:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.861030:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135849.861085:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545095680 00000100:00100000:1.0:1789135849.861089:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545095680 00000100:00100000:1.0:1789135849.861121:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135849.861127:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+9:14724:x1876044545095680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789135849.861396:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+9:14724:x1876044545095680:12345-0@lo:503:mount.lustre.0 Request processed in 268us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135849.861403:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789135849.861545:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545095680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789135849.862211:0:14760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14760:1876044545095808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135849.862269:0:14760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135849.862303:0:14760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc392f1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135849.862398:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545095808 00000100:00100000:1.0:1789135849.862403:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545095808 00000100:00100000:1.0:1789135849.862461:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135849.862469:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+9:14760:x1876044545095808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135849.862736:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+9:14760:x1876044545095808:12345-0@lo:502:llog_process_th.0 Request processed in 267us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135849.862743:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135849.862863:0:14760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14760:1876044545095808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135849.862886:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135849.862895:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135849.862897:0:14760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789135849.862903:0:14760:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789135849.862906:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135849.862918:0:14760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8adc41700000) 00000020:00000080:3.0:1789135849.862933:0:14760:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789135849.862942:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789135849.862997:0:14760:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789135849.863002:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce4fb4 00000020:00000080:3.0:1789135849.863387:0:14760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789135849.863392:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135849.863396:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135849.863397:0:14760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789135849.863400:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135849.863403:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135849.863405:0:14760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789135849.863408:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135849.863415:0:14760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8adc41704ed8) 00000020:00000080:3.0:1789135849.863425:0:14760:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789135849.863429:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789135849.863431:0:14760:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789135849.863434:0:14760:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789135849.863440:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789135849.863486:0:14760:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc1a4e1800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789135849.863498:0:14760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8adc41703490) 00000020:00000080:3.0:1789135849.863506:0:14760:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789135849.863542:0:14760:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789135849.863546:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce4fc9 00000020:00000080:3.0:1789135849.863641:0:14760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789135849.863646:0:14760:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789135849.863650:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5b09da6ee1ce4fd0 00080000:01000000:3.0:1789135849.863655:0:14760:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789135849.863658:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce4fd7 00010000:00010000:2.0:1789135849.952982:0:14760:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789135849.955646:0:14760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789135849.956126:0:14760:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789135849.956707:0:14760:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8adc04f24ed8) 00000020:00000080:2.0:1789135849.956724:0:14760:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789135849.956787:0:14760:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789135849.956793:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce4fe5 00000020:00000080:1.0:1789135849.960921:0:14760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789135849.964341:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5b09da6ee1ce4fec 00000020:00000080:1.0:1789135849.975365:0:14760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789135849.975379:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135849.975387:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.975389:0:14760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789135849.975393:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789135849.975395:0:14760:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789135849.975396:0:14760:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789135849.975398:0:14760:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789135849.975399:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789135849.975401:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.975403:0:14760:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789135849.975405:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135849.975418:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.975420:0:14760:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789135849.975424:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789135849.975468:0:14760:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789135849.975482:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135849.975485:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.975487:0:14760:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789135849.975490:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789135849.975493:0:14760:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789135849.975496:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.975497:0:14760:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789135849.975501:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789135849.975505:0:14760:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.135@tcp to nid 0x20000c0a8ce87 (192.168.206.135@tcp) 00000020:01000000:1.0:1789135849.975529:0:14760:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789135849.975531:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789135849.975545:0:14760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8adb01d03490) 00000020:00000080:1.0:1789135849.975561:0:14760:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789135849.975565:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789135849.975643:0:14760:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789135849.975649:0:14760:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789135849.975655:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce4ffa 00010000:00080000:1.0:1789135849.975706:0:14760:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adc07efe000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1789135849.975918:0:14760:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789135849.976364:0:14760:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789135849.976408:0:14760:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789135849.977305:0:14760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135849.977383:0:14760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789135849.977454:0:14760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789135849.981446:0:14764:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789135849.981454:0:14764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789135849.985333:0:14760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789135849.985356:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789135849.985392:0:14760:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789135849.985408:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce5001 00000100:00080000:1.0:1789135849.985418:0:14760:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135849.985424:0:14760:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adc07efe000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1789135849.985459:0:14760:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3496c780 x1876044545095936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135849.985483:0:14760:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789135849.985536:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135849.985539:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.985541:0:14760:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789135849.985544:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789135849.985547:0:14760:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789135849.985548:0:14760:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789135849.985549:0:14760:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789135849.985551:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789135849.985553:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.985554:0:14760:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789135849.985557:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789135849.985560:0:14760:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789135849.985563:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.985565:0:14760:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789135849.985567:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789135849.985571:0:14760:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.135@tcp to nid 0x20000c0a8ce87 (192.168.206.135@tcp) 00000020:01000000:1.0:1789135849.985603:0:14760:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789135849.985606:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789135849.985617:0:14760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8adb01d04ed8) 00000020:00000080:1.0:1789135849.985627:0:14760:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789135849.985631:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789135849.985704:0:14760:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789135849.985709:0:14760:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789135849.985719:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b09da6ee1ce500f 00010000:00080000:1.0:1789135849.985746:0:14760:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adc0579c000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1789135849.985933:0:14760:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789135849.986136:0:14760:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789135849.986159:0:14760:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789135849.986663:0:14760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135849.986730:0:14760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789135849.986797:0:14760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1789135849.987364:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545095936:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789135849.987422:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044545095936 offset 0 length 520: 4 00000040:00080000:1.0:1789135849.990639:0:14766:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789135849.990647:0:14766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789135849.991406:0:14760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789135849.991418:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789135849.991447:0:14760:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789135849.991465:0:14760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce5016 00000100:00080000:1.0:1789135849.991477:0:14760:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135849.991483:0:14760:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adc0579c000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1789135849.991517:0:14760:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3496c000 x1876044545096064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135849.991546:0:14760:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789135849.991603:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135849.991607:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.991608:0:14760:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789135849.991611:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135849.991615:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.991616:0:14760:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135849.991618:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135849.991620:0:14760:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789135849.991622:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135849.991624:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.991626:0:14760:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789135849.991628:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135849.991637:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135849.991639:0:14760:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789135849.991643:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789135849.991672:0:14760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14760:1876044545096192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135849.991864:0:14760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135849.991897:0:14760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135849.991973:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545096064:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789135849.992011:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044545096064 offset 0 length 520: 4 00000100:00100000:3.0:1789135849.992157:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545096192 00000100:00100000:3.0:1789135849.992173:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545096192 00000100:00100000:3.0:1789135849.992217:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135849.992227:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+9:14760:x1876044545096192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135849.992451:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+9:14760:x1876044545096192:12345-0@lo:502:llog_process_th.0 Request processed in 224us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135849.992463:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135849.992618:0:14760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14760:1876044545096192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135849.992647:0:14760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135849.992652:0:14760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135849.992654:0:14760:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789135849.992659:0:14760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789135849.992884:0:14724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789135849.992901:0:14724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789135849.992920:0:14724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f2000/0x5b09da6ee1ce4f9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4fa6 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.992929:0:14724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc340f2000/0x5b09da6ee1ce4f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4fa6 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135849.992937:0:14724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc1a4e1800 from 1 10000000:01000000:2.0:1789135849.992939:0:14724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789135849.992964:0:14724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.992971:0:14724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.992980:0:14724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135849.992994:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789135849.993040:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.993098:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135849.993174:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545096320 00000100:00100000:1.0:1789135849.993179:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545096320 00000100:00100000:1.0:1789135849.993213:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789135849.993221:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+9:14724:x1876044545096320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789135849.993231:0:14734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135849.993242:0:14734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce501d expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135849.993262:0:14734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 10 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135849.993272:0:14734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 10 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135849.993281:0:14734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01481a00, rc 0) 00000100:00100000:1.0:1789135849.993311:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+10:14724:x1876044545096320:12345-0@lo:101:mount.lustre.0 Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135849.993316:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135849.993439:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135849.993451:0:14724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.993460:0:14724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135849.994020:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096448:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789135849.994100:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.994123:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135849.994146:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545096448 00000100:00100000:2.0:1789135849.994150:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545096448 00000100:00100000:2.0:1789135849.994187:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135849.994194:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+10:14724:x1876044545096448:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789135849.994208:0:14736:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789135849.994214:0:14736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789135849.994275:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+10:14724:x1876044545096448:12345-0@lo:256:mount.lustre.0 Request processed in 81us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135849.994282:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135849.994315:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096448:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789135849.994884:0:14724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789135849.994893:0:14724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.994903:0:14724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135849.994910:0:14724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc1a4e1800 from 1 10000000:01000000:2.0:1789135849.994913:0:14724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135849.994936:0:14724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.994944:0:14724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.995001:0:14724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135849.995017:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789135849.995058:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.995102:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135849.995125:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545096576 00000100:00100000:2.0:1789135849.995130:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545096576 00000100:00100000:2.0:1789135849.995156:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135849.995163:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+10:14724:x1876044545096576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135849.995172:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135849.995183:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce502b expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.995197:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 11 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.995206:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 11 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.995212:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3200, rc 0) 00000100:00100000:2.0:1789135849.995239:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14724:x1876044545096576:12345-0@lo:101:mount.lustre.0 Request processed in 77us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135849.995245:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135849.995277:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135849.995288:0:14724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135849.995302:0:14724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135849.995344:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135849.995372:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.995385:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135849.995397:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545096704 00000100:00100000:2.0:1789135849.995400:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545096704 00000100:00100000:2.0:1789135849.995416:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135849.995422:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14724:x1876044545096704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135849.995759:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14724:x1876044545096704:12345-0@lo:501:mount.lustre.0 Request processed in 336us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135849.995766:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135849.995796:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135849.995821:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789135849.995856:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135849.995870:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135849.995882:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545096832 00000100:00100000:2.0:1789135849.995885:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545096832 00000100:00100000:2.0:1789135849.995902:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789135849.995907:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14724:x1876044545096832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789135849.996027:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14724:x1876044545096832:12345-0@lo:503:mount.lustre.0 Request processed in 119us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135849.996033:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789135849.996088:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545096832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789135849.996239:0:14768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14768:1876044545096960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135849.997381:0:14768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135849.997508:0:14768:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135849.998051:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545096960 00000100:00100000:0.0:1789135849.998059:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545096960 00000100:00100000:0.0:1789135849.998256:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789135849.998267:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14768:x1876044545096960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135849.998547:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14768:x1876044545096960:12345-0@lo:502:llog_process_th.0 Request processed in 282us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135849.998555:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135849.998650:0:14768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14768:1876044545096960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135849.998691:0:14768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135849.998699:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135849.998701:0:14768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789135849.998708:0:14768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc1a4e1800 00000020:00000080:2.0:1789135849.998711:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789135849.998717:0:14768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135849.998720:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135849.998721:0:14768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789135849.998723:0:14768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135849.998726:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135849.998727:0:14768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135849.998730:0:14768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc1a4e1800 00000020:00000080:2.0:1789135849.998732:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789135849.998794:0:14768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135849.998797:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135849.998799:0:14768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789135849.998801:0:14768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135849.998803:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135849.998804:0:14768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789135849.998808:0:14768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc1a4e1800 00000020:00000080:2.0:1789135849.998810:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789135849.998828:0:14768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135849.998831:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135849.998832:0:14768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789135849.998835:0:14768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135849.998837:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135849.998844:0:14768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789135849.998849:0:14768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc1a4e1800 00000020:00000080:2.0:1789135849.998850:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135849.998910:0:14768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14768:1876044545097088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135849.998951:0:14768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135850.006281:0:14768:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6ea80 going to sleep for 10 seconds 00000100:00100000:3.0:1789135850.009644:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545097088 00000100:00100000:3.0:1789135850.009658:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545097088 00000100:00100000:3.0:1789135850.009725:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789135850.009735:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14768:x1876044545097088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135850.010000:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14768:x1876044545097088:12345-0@lo:502:llog_process_th.0 Request processed in 266us (11048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135850.010008:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789135850.013050:0:14768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14768:1876044545097088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135850.013102:0:14768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135850.013111:0:14768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135850.013113:0:14768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789135850.013117:0:14768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789135850.013246:0:14724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789135850.013264:0:14724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135850.013281:0:14724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135850.013293:0:14724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135850.013334:0:14724:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789135850.013337:0:14724:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adc1a4e1800 10000000:01000000:2.0:1789135850.013340:0:14724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adc1a4e1800 10000000:01000000:2.0:1789135850.013343:0:14724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135850.013349:0:14724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc1a4e1800 from 1 10000000:01000000:2.0:1789135850.013351:0:14724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135850.013383:0:14724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f3800/0x5b09da6ee1ce5039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135850.013391:0:14724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc340f3800/0x5b09da6ee1ce5039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135850.013412:0:14724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc340f3800/0x5b09da6ee1ce5039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135850.013431:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545097216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789135850.013489:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135850.013528:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135850.014265:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545097216 00000100:00100000:3.0:1789135850.014273:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545097216 00000100:00100000:3.0:1789135850.014308:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789135850.014317:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14724:x1876044545097216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789135850.014331:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135850.014346:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31ea00/0x5b09da6ee1ce5040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce5039 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.014368:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31ea00/0x5b09da6ee1ce5040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5039 expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.014377:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31ea00/0x5b09da6ee1ce5040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5039 expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.014386:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31ea00, rc 0) 00000100:00100000:3.0:1789135850.014440:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14724:x1876044545097216:12345-0@lo:101:mount.lustre.0 Request processed in 123us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135850.014446:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135850.014786:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545097216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135850.014802:0:14724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc340f3800/0x5b09da6ee1ce5039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5040 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135850.014811:0:14724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc340f3800/0x5b09da6ee1ce5039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce5040 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135850.014865:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545097344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135850.014974:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135850.014997:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135850.015793:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545097344 00000100:00100000:0.0:1789135850.015800:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545097344 00000100:00100000:0.0:1789135850.015838:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135850.015845:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14724:x1876044545097344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789135850.016290:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14724:x1876044545097344:12345-0@lo:501:mount.lustre.0 Request processed in 444us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135850.016297:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789135850.016809:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545097344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135850.016857:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545097472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789135850.017027:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135850.017142:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135850.017293:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545097472 00000100:00100000:0.0:1789135850.017299:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545097472 00000100:00100000:0.0:1789135850.017369:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135850.017377:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14724:x1876044545097472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789135850.017542:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14724:x1876044545097472:12345-0@lo:503:mount.lustre.0 Request processed in 166us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135850.017550:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789135850.017617:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545097472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789135850.027778:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14773:1876044545097600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135850.027848:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135850.027989:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135850.028609:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545097600 00000100:00100000:2.0:1789135850.028616:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545097600 00000100:00100000:2.0:1789135850.028656:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789135850.028663:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14773:x1876044545097600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135850.029013:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14773:x1876044545097600:12345-0@lo:502:llog_process_th.0 Request processed in 349us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135850.029020:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789135850.029188:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14773:1876044545097600:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789135850.029247:0:14773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789135850.029259:0:14773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8adb01d01a48) 00000020:00000080:1.0:1789135850.029275:0:14773:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789135850.029351:0:14773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc1a4e1800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789135850.029354:0:14773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc1a4e1800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789135850.029357:0:14773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc1a4e1800 4 00010000:00080000:1.0:1789135850.029381:0:14773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adc41d65000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.135@tcp at head 00010000:00010000:1.0:1789135850.031009:0:14773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789135850.038562:0:14773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789135850.038616:0:14773:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789135850.038628:0:14773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5b09da6ee1ce504e 00000100:00080000:1.0:1789135850.038639:0:14773:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135850.038645:0:14773:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8adc41d65000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1789135850.038756:0:14773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3496ed00 x1876044545097728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135850.038781:0:14773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789135850.039107:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14773:1876044545097856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135850.039294:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545097728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789135850.039338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135850.039532:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545097728 00000100:00100000:2.0:1789135850.039539:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545097728 00000100:00100000:2.0:1789135850.039571:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135850.039578:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876044545097728:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789135850.039637:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876044545097728:12345-0@lo:38:llog_process_th.0 Request processed in 57us (299us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789135850.039645:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135850.039674:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789135850.039755:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc41d65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789135850.039760:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789135850.039763:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545097728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789135850.040265:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135850.040299:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545097856 00000100:00100000:1.0:1789135850.040303:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545097856 00000100:00100000:1.0:1789135850.040333:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789135850.040339:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14773:x1876044545097856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135850.040550:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14773:x1876044545097856:12345-0@lo:502:llog_process_th.0 Request processed in 210us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135850.040558:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789135850.040605:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135850.040618:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14773:1876044545097856:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789135850.040644:0:14773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789135850.040939:0:14724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789135850.040957:0:14724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789135850.041010:0:14724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f3800/0x5b09da6ee1ce5039 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5040 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135850.041021:0:14724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc340f3800/0x5b09da6ee1ce5039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5040 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789135850.041088:0:14724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789135850.041091:0:14724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789135850.041092:0:14724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135850.041097:0:14724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135850.041098:0:14724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135850.041100:0:14724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135850.041101:0:14724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789135850.041102:0:14724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789135850.041104:0:14724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135850.041105:0:14724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789135850.041108:0:14724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789135850.041111:0:14724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789135850.041112:0:14724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789135850.041113:0:14724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135850.041114:0:14724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135850.041115:0:14724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135850.041116:0:14724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135850.041117:0:14724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789135850.041118:0:14724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789135850.041119:0:14724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135850.041120:0:14724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789135850.041146:0:14724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789135850.041158:0:14724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545097984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789135850.041204:0:14724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135850.041230:0:14724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04e6ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135850.043409:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545097984 00000100:00100000:1.0:1789135850.043421:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545097984 00000100:00100000:1.0:1789135850.043467:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135850.043476:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14724:x1876044545097984:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789135850.043504:0:14734:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789135850.043516:0:14734:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789135850.084476:0:14734:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789135850.084517:0:14734:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789135850.085686:0:14758:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789135850.085693:0:14758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789135850.085713:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.085732:0:14758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 12 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.085741:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.085783:0:14758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 12 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.085797:0:14758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 12 pid: 14734 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135850.085811:0:14758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d65e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14758:1876044545098112:0@lo:104: 00000100:00100000:3.0:1789135850.085872:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135850.085923:0:14758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135850.086106:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545098112 00000100:00100000:0.0:1789135850.086113:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545098112 00000100:00100000:0.0:1789135850.086153:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135850.086162:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:14758:x1876044545098112:12345-0@lo:104: 00010000:00010000:0.0:1789135850.086185:0:14725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086233:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135850.086239:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:14758:x1876044545098112:12345-0@lo:104: Request processed in 79us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135850.086246:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789135850.086267:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135850.086272:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086278:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3400 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:0.0:1789135850.086282:0:14731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086302:0:14731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135850.086310:0:14731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135850.086316:0:14731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135850.086343:0:14731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086349:0:14731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135850.086370:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086378:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc340f3400/0x5b09da6ee1ce501d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5024 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086392:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135850.086394:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135850.086396:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135850.086419:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135850.086429:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3316:1876044545098240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135850.086455:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135850.086495:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545098240 00000100:00100000:0.0:1789135850.086499:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545098240 00010000:00010000:0.0:1789135850.086514:0:14727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 13 pid: 14734 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135850.086533:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135850.086544:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+13:3316:x1876044545098240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135850.086565:0:14727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135850.086571:0:14727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 13 pid: 14734 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086581:0:14727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 13 pid: 14734 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086612:0:14727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086619:0:14727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789135850.086632:0:14727:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000939921s 00010000:00010000:0.0:1789135850.086636:0:14727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086643:0:14727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086651:0:14727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086658:0:14727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086664:0:14727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135850.086668:0:14727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086697:0:14727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086706:0:14727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135850.086716:0:14727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135850.086743:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+13:3316:x1876044545098240:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135850.086750:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135850.086782:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3316:1876044545098240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135850.087029:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01481a00/0x5b09da6ee1ce5024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce501d expref: 12 pid: 14734 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135850.087039:0:14758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d65e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14758:1876044545098112:0@lo:104: 00010000:00010000:3.0:1789135850.087052:0:14758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.087084:0:14758:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.087091:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135850.087105:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc3a31e200/0x5b09da6ee1ce5055 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135850.095431:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14724:x1876044545097984:12345-0@lo:253:mount.lustre.0 Request processed in 51950us (54218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135850.095444:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135850.095574:0:14724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14724:1876044545097984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789135850.095602:0:14724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789135850.095606:0:14724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789135850.095607:0:14724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789135850.095608:0:14724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135850.095610:0:14724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135850.095611:0:14724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135850.095612:0:14724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135850.095614:0:14724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789135850.095615:0:14724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789135850.095617:0:14724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135850.095618:0:14724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789135850.095631:0:14724:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789135850.102791:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135850.102967:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135850.103295:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135850.103451:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135850.103727:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135850.103889:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135850.105240:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135850.105395:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789135850.105624:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789135850.105842:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789135850.106428:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135850.106616:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789135850.124137:0:14724:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789135850.124477:0:14724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789135850.124600:0:14780:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789135850.124604:0:14780:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789135850.124710:0:14781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789135850.124781:0:14781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135850.126868:0:14781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789135850.126940:0:14781:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789135850.126944:0:14781:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789135850.129288:0:14724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789135850.129415:0:14724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789135850.129833:0:14724:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789135850.129841:0:14724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789135850.129959:0:14724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135850.131631:0:14724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789135850.132389:0:14724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789135850.132424:0:14724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789135850.132906:0:14724:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1789135850.133836:0:14724:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789135850.138636:0:14724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789135850.163620:0:14724:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789135850.163660:0:14724:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f1c0dd3988 00100000:10000000:3.0:1789135850.163668:0:14724:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789135850.171996:0:14724:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789135850.172015:0:14724:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789135850.172033:0:14724:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789135850.172060:0:14724:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789135850.700280:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789135851.021713:0:14774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135851.021723:0:14774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135851.022397:0:14774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789135851.022406:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1789135851.596234:0:14739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789135851.596241:0:14739:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc1a4e1800 from 6 10000000:01000000:0.0:1789135851.596246:0:14739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135851.596288:0:14739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135851.596300:0:14739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135851.596311:0:14739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135851.596337:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545098368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135851.596403:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.596512:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05f9f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135851.599226:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545098368 00000100:00100000:2.0:1789135851.599239:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545098368 00000100:00100000:2.0:1789135851.599301:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135851.599313:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14739:x1876044545098368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135851.599329:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135851.599347:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce505c expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135851.599374:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135851.599399:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135851.599408:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3a00, rc 0) 00000100:00100000:2.0:1789135851.602540:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14739:x1876044545098368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3221us (6127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135851.602553:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789135851.605356:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545098368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135851.605383:0:14739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135851.605395:0:14739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135851.605479:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545098496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789135851.605539:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.605595:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05f9f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135851.605662:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545098496 00000100:00100000:2.0:1789135851.605668:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545098496 00000100:00100000:2.0:1789135851.605718:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789135851.605727:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14739:x1876044545098496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789135851.605745:0:14734:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789135851.605760:0:14734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789135851.605763:0:14734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789135851.605837:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14739:x1876044545098496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135851.605845:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789135851.607310:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cee580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545098496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789135851.607369:0:14739:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789135851.607378:0:14739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135851.607389:0:14739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135851.734133:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135852.044406:0:14774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135852.044414:0:14774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135852.044444:0:14774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789135852.044450:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789135852.751750:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135853.773441:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135853.877894:0:15023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789135854.802650:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789135855.120941:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789135855.120948:0:14302:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789135855.120951:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789135855.120953:0:14302:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789135855.120955:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789135855.120958:0:14302:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789135855.120985:0:14302:0:(import.c:65:import_set_state_nolock()) ffff8adc41d65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789135855.120996:0:14302:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8adc41d65000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:1.0:1789135855.121018:0:14302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3496de00 x1876044545098752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789135855.121079:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3316:1876044545098624:0@lo:400:kworker.0 00000100:00100000:1.0:1789135855.121147:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135855.121220:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545098752:0@lo:38:kworker.0 00000100:00100000:3.0:1789135855.121244:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545098624 00000100:00100000:3.0:1789135855.121252:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545098624 00000100:00100000:1.0:1789135855.121253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135855.121307:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135855.121317:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:3316:x1876044545098624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135855.121374:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:3316:x1876044545098624:12345-0@lo:400:kworker.0 Request processed in 58us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135855.121382:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135855.121433:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3316:1876044545098624:0@lo:400:kworker.0 00000100:00100000:0.0:1789135855.121434:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545098752 00000100:00100000:0.0:1789135855.121441:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545098752 00000100:00100000:0.0:1789135855.121466:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135855.121480:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876044545098752:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789135855.121500:0:14744:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1789135855.121534:0:14744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5b09da6ee1ce506a 00000004:00100000:0.0:1789135855.121548:0:14744:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789135855.121685:0:14744:0:(import.c:65:import_set_state_nolock()) ffff8adc3ad44000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135855.122610:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876044545098752:12345-0@lo:38:kworker.0 Request processed in 1130us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135855.122621:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789135855.124054:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc3496de00 x1876044545098752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789135855.124106:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789135855.124115:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789135855.124120:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789135855.124132:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc41d65000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789135855.124140:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876044545098752:0@lo:38:kworker.0 00010000:00010000:0.0:1789135855.821603:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789135856.538591:0:15174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc168e68e0 20000000:00000080:1.0:1789135856.538607:0:15174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc35642000 uarg=0000000000000000 20000000:01000000:1.0:1789135856.538639:0:15174:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789135856.538645:0:15174:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789135856.538650:0:15174:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789135856.539433:0:15175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789135856.539686:0:15174:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789135856.548287:0:15174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789135856.548736:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135856.548753:0:15174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 11 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135856.548762:0:15174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135856.548816:0:15174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 11 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135856.548832:0:15174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 11 pid: 14736 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135856.549028:0:15174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15174:1876044545098880:0@lo:104: 00000100:00100000:1.0:1789135856.549378:0:15174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135856.549482:0:15174:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3a30f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789135856.549533:0:14726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545098880 00000100:00100000:0.0:1789135856.549540:0:14726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545098880 00000100:00100000:0.0:1789135856.549619:0:14726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135856.549629:0:14726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:15174:x1876044545098880:12345-0@lo:104: 00010000:00010000:0.0:1789135856.549645:0:14726:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135856.549856:0:14726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135856.549863:0:14726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:15174:x1876044545098880:12345-0@lo:104: Request processed in 235us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.549870:0:14726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789135856.550087:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135856.550094:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550102:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3c00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135856.550106:0:14730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550114:0:14730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135856.550128:0:14730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135856.550145:0:14730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135856.550414:0:14730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550422:0:14730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135856.550450:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550457:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc340f3c00/0x5b09da6ee1ce502b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5032 expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550474:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135856.550475:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135856.550477:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135856.550497:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135856.550507:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3314:1876044545099008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135856.550559:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135856.550603:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545099008 00000100:00100000:2.0:1789135856.550609:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545099008 00010000:00010000:2.0:1789135856.550633:0:14727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 12 pid: 14736 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135856.550658:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135856.550664:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:3314:x1876044545099008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135856.550675:0:14727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135856.550687:0:14727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 12 pid: 14736 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550698:0:14727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 12 pid: 14736 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550714:0:14727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550723:0:14727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550739:0:14727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550745:0:14727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550751:0:14727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550756:0:14727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550762:0:14727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135856.550765:0:14727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550772:0:14727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550780:0:14727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135856.550797:0:14727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135856.550828:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:3314:x1876044545099008:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135856.550835:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135856.551032:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3314:1876044545099008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135856.551325:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce5032 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce502b expref: 11 pid: 14736 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135856.551338:0:15174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15174:1876044545098880:0@lo:104: 00010000:00010000:1.0:1789135856.551353:0:15174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135856.551361:0:15174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135856.551367:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135856.551384:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce5071 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135856.847262:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135857.870986:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135858.254298:0:14739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135858.254305:0:14739:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc1a4e1800 from 13 10000000:01000000:1.0:1789135858.254310:0:14739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135858.254363:0:14739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135858.254376:0:14739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135858.254386:0:14739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135858.254412:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545099136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135858.254491:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135858.254548:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc02d209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135858.254704:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545099136 00000100:00100000:0.0:1789135858.254712:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545099136 00000100:00100000:0.0:1789135858.254768:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135858.254779:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+11:14739:x1876044545099136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135858.254792:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135858.254804:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce5078 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135858.254825:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 12 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135858.254835:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 12 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135858.254844:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045c00, rc 0) 00000100:00100000:0.0:1789135858.254884:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14739:x1876044545099136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135858.254891:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135858.254938:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545099136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135858.254965:0:14739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135858.254974:0:14739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135858.255026:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cefc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545099264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135858.255056:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135858.255122:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0540a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135858.255939:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545099264 00000100:00100000:1.0:1789135858.255948:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545099264 00000100:00100000:1.0:1789135858.256136:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135858.256147:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14739:x1876044545099264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135858.256612:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14739:x1876044545099264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 467us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135858.256620:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135858.256800:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cefc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545099264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135858.256843:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cefc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545099392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135858.256888:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135858.256921:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0540a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135858.257596:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545099392 00000100:00100000:1.0:1789135858.257603:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545099392 00000100:00100000:1.0:1789135858.257651:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135858.257658:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14739:x1876044545099392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135858.257828:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:14739:x1876044545099392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135858.257834:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135858.257923:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cefc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545099392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789135858.264030:0:15253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789135858.264755:0:14739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789135858.264775:0:14739:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135858.264786:0:14739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135858.264867:0:14739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135858.892387:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135859.212774:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789135849/real 1789135849] req@ffff8adc3496c000 x1876044545096064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789135859 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135859.212809:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc3496c000 x1876044545096064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789135859 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135859.212820:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789135849/real 1789135849] req@ffff8adc3496c780 x1876044545095936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789135859 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135859.212831:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc3496c780 x1876044545095936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789135859 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789135859.212847:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc0579c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789135859.212871:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789135859.212876:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545096064:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789135859.212882:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc07efe000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789135859.212887:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789135859.212890:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545095936:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789135859.214097:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789135859.214102:0:14302:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789135859.214106:0:14302:0:(import.c:65:import_set_state_nolock()) ffff8adc07efe000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789135859.214112:0:14302:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1789135859.214127:0:14302:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789135859.214135:0:14302:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adc07efe000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1789135859.214157:0:14302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3a2e92c0 x1876044545099648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135859.214171:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789135859.214174:0:14302:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789135859.214175:0:14302:0:(import.c:65:import_set_state_nolock()) ffff8adc0579c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789135859.214178:0:14302:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1789135859.214180:0:14302:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789135859.214183:0:14302:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adc0579c000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:2.0:1789135859.214297:0:14302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc3a2e8780 x1876044545099776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135859.214559:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135859.214574:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545099520:0@lo:400:kworker.0 00000100:00100000:3.0:1789135859.214640:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135859.214700:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545099904:0@lo:400:kworker.0 00000100:00100000:3.0:1789135859.214729:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135859.214852:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545099520 00000100:00100000:2.0:1789135859.214858:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545099520 00000100:00100000:2.0:1789135859.214922:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789135859.214944:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:3313:x1876044545099520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135859.214986:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:3313:x1876044545099520:12345-0@lo:400:kworker.0 Request processed in 44us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135859.214993:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789135859.215339:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545099904 00000100:00100000:1.0:1789135859.215461:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545099904 00000100:00100000:1.0:1789135859.215498:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135859.215506:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545099904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135859.215573:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545099904:12345-0@lo:400:kworker.0 Request processed in 68us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135859.215579:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135859.215599:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545099648:0@lo:8:kworker.0 00000400:00000100:1.0:1789135859.215622:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044545099648 offset 0 length 520: 4 00000100:00100000:1.0:1789135859.215643:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545099776:0@lo:8:kworker.0 00000400:00000100:1.0:1789135859.215660:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044545099776 offset 0 length 520: 4 00010000:00080000:0.0:1789135859.215814:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc3a2ea580 x1876044545099904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135859.215827:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545099904:0@lo:400:kworker.0 00000100:00100000:3.0:1789135859.216129:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545099520:0@lo:400:kworker.0 00010000:00010000:0.0:1789135859.917711:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789135860.911035:0:15422:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789135860.911056:0:15422:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789135860.911392:0:15422:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adc08fc4000 00000020:01000004:3.0:1789135860.911430:0:15422:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789135860.911457:0:15422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789135860.911488:0:15422:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8adc07719a48) 00000020:00000080:3.0:1789135860.911520:0:15422:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1789135860.940815:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789135860.949016:0:15422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789135860.949263:0:15422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789135860.950143:0:15422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789135860.950399:0:15422:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789135860.950765:0:15422:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789135860.951123:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 91: rc = 0 00100000:10000000:3.0:1789135860.951218:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 91: rc = 0 00100000:10000000:3.0:1789135860.951464:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 91: rc = 0 00100000:10000000:3.0:1789135860.952040:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 404: rc = 0 00100000:10000000:3.0:1789135860.954465:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 404: rc = 0 00100000:10000000:3.0:1789135860.954889:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 404: rc = 0 00100000:10000000:3.0:1789135860.955254:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 404: rc = 0 00100000:10000000:3.0:1789135860.955595:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 404: rc = 0 00100000:10000000:3.0:1789135860.956316:0:15422:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 404: rc = 0 00000020:00000080:3.0:1789135860.960404:0:15422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789135860.960418:0:15422:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789135860.960428:0:15422:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b09da6ee1ce508d 00000020:01000004:3.0:1789135860.960435:0:15422:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789135860.960454:0:15422:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789135860.960457:0:15422:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789135860.960464:0:15422:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789135860.960468:0:15422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789135860.960479:0:15422:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8adc07718000) 00000020:00000080:3.0:1789135860.960891:0:15422:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789135860.965682:0:15422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135860.968140:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789135860.968149:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789135860.976998:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789135860.977011:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789135860.978766:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789135860.978831:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789135860.985760:0:15422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135860.986327:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789135860.986334:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789135860.987688:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789135860.987697:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789135861.005000:0:15422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135861.005479:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789135861.005486:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789135861.007513:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789135861.007538:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789135861.009246:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789135861.009258:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789135861.012445:0:15422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135861.012687:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789135861.012695:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789135861.014360:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789135861.014371:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789135861.059016:0:15422:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135861.060581:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789135861.060590:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789135861.062425:0:15422:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789135861.062436:0:15422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789135861.063059:0:15422:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789135861.063124:0:15422:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789135861.063131:0:15422:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789135861.082710:0:15422:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789135861.082756:0:15422:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.135@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789135861.082760:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789135861.082761:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135861.082763:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135861.082764:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135861.082765:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135861.082766:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135861.082767:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135861.082769:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135861.082770:0:15422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789135861.082839:0:15422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789135861.082848:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135861.082849:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135861.082850:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135861.082851:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135861.082852:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135861.082853:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135861.082854:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135861.082855:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135861.082856:0:15422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789135861.083188:0:15422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789135861.083208:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789135861.083272:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.083576:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.083628:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545100032 00000100:00100000:0.0:1789135861.083634:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545100032 00000100:00100000:0.0:1789135861.083764:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789135861.083784:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:15422:x1876044545100032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789135861.083814:0:14734:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789135861.083817:0:14734:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789135861.083827:0:14734:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789135861.090701:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:15422:x1876044545100032:12345-0@lo:253:mount.lustre.0 Request processed in 6920us (7419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.090716:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135861.090869:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789135861.091009:0:15422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789135861.091013:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135861.091014:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135861.091016:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135861.091017:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135861.091018:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135861.091019:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135861.091020:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135861.091022:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135861.091024:0:15422:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789135861.091042:0:15422:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adc08fc4000 from lustre-OST0000 10000000:01000000:3.0:1789135861.091254:0:15422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789135861.091258:0:15422:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789135861.091265:0:15422:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adc04f21a48 local copy 00010000:00010000:3.0:1789135861.091275:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135861.091513:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789135861.091567:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.091611:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.091730:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545100160 00000100:00100000:0.0:1789135861.091736:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545100160 00000100:00100000:0.0:1789135861.091784:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789135861.091792:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:15422:x1876044545100160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789135861.091966:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:15422:x1876044545100160:12345-0@lo:501:mount.lustre.0 Request processed in 174us (399us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135861.091975:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789135861.092327:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100160:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789135861.092341:0:15422:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789135861.092503:0:15422:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789135861.092510:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.092519:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135861.092547:0:15422:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adc08fc4000 10000000:01000000:3.0:1789135861.092551:0:15422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789135861.092555:0:15422:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8adc04f21a48 10000000:01000000:3.0:1789135861.092557:0:15422:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789135861.092560:0:15422:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8adc04f21a48 from 1 10000000:01000000:3.0:1789135861.092563:0:15422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789135861.092587:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e200/0x5b09da6ee1ce509b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.092594:0:15422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e200/0x5b09da6ee1ce509b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.092602:0:15422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e200/0x5b09da6ee1ce509b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135861.092614:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789135861.092645:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.092680:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.092813:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545100288 00000100:00100000:0.0:1789135861.092819:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545100288 00000100:00100000:0.0:1789135861.092847:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135861.092854:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+12:15422:x1876044545100288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789135861.092864:0:14734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135861.092886:0:14734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc42045e00/0x5b09da6ee1ce50a2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce509b expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.092906:0:14734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc42045e00/0x5b09da6ee1ce50a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce509b expref: 13 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.092917:0:14734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc42045e00/0x5b09da6ee1ce50a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce509b expref: 13 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.092925:0:14734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045e00, rc 0) 00000100:00100000:0.0:1789135861.092968:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+13:15422:x1876044545100288:12345-0@lo:101:mount.lustre.0 Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.092984:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789135861.093389:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789135861.093402:0:15422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e200/0x5b09da6ee1ce509b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50a2 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.093417:0:15422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e200/0x5b09da6ee1ce509b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce50a2 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135861.093432:0:15422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789135861.093451:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e200/0x5b09da6ee1ce509b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50a2 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.093457:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc3a31e200/0x5b09da6ee1ce509b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50a2 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135861.093464:0:15422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789135861.093467:0:15422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135861.093471:0:15422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789135861.093473:0:15422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789135861.093609:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31f800/0x5b09da6ee1ce50a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.093617:0:15422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc3a31f800/0x5b09da6ee1ce50a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.093624:0:15422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc3a31f800/0x5b09da6ee1ce50a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135861.093637:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789135861.093668:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.093690:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135861.093753:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545100416 00000100:00100000:2.0:1789135861.093758:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545100416 00000100:00100000:2.0:1789135861.093797:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789135861.093806:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+13:15422:x1876044545100416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135861.093814:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135861.093824:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc340f2200/0x5b09da6ee1ce50b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce50a9 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135861.093838:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc340f2200/0x5b09da6ee1ce50b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50a9 expref: 14 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135861.093847:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc340f2200/0x5b09da6ee1ce50b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50a9 expref: 14 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135861.093853:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f2200, rc 0) 00000100:00100000:2.0:1789135861.093895:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100416:12345-0@lo:101:mount.lustre.0 Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.093902:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789135861.094271:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789135861.094283:0:15422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc3a31f800/0x5b09da6ee1ce50a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50b0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.094299:0:15422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc3a31f800/0x5b09da6ee1ce50a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce50b0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135861.095808:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789135861.097730:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135861.098441:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789135861.098579:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789135861.098621:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789135861.098686:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789135861.098728:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789135861.098765:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789135861.099844:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789135861.099860:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789135861.100342:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789135861.100411:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.100461:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135861.100656:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545100544 00000100:00100000:2.0:1789135861.100663:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545100544 00000100:00100000:2.0:1789135861.100714:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789135861.100725:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135861.101456:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100544:12345-0@lo:501:mount.lustre.0 Request processed in 732us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.101464:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789135861.101824:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789135861.101869:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789135861.102212:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.102249:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.102300:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545100672 00000100:00100000:0.0:1789135861.102306:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545100672 00000100:00100000:0.0:1789135861.102355:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789135861.102363:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789135861.102998:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100672:12345-0@lo:503:mount.lustre.0 Request processed in 410us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.103007:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789135861.103183:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100672:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789135861.104869:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789135861.104953:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789135861.105015:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.105056:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135861.105801:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545100800 00000100:00100000:2.0:1789135861.105808:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545100800 00000100:00100000:2.0:1789135861.105848:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135861.105857:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789135861.106156:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100800:12345-0@lo:502:mount.lustre.0 Request processed in 299us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.106164:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789135861.106944:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789135861.107404:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789135861.107461:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789135861.107498:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789135861.107559:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789135861.107597:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789135861.107626:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789135861.107669:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789135861.107708:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789135861.107742:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789135861.107791:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789135861.107826:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789135861.107873:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789135861.107913:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789135861.108568:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.108664:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.110092:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545100928 00000100:00100000:0.0:1789135861.110161:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545100928 00000100:00100000:0.0:1789135861.110220:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789135861.110230:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789135861.110666:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545100928:12345-0@lo:502:mount.lustre.0 Request processed in 437us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.110675:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135861.110761:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545100928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789135861.110930:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789135861.111015:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789135861.113286:0:15436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789135861.113297:0:15436:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789135861.113312:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135861.113315:0:15436:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789135861.113393:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789135861.113408:0:15436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8adc0478ced8) 00000020:00000080:0.0:1789135861.113428:0:15436:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789135861.113434:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789135861.113502:0:15436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc08fc4000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789135861.113509:0:15436:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789135861.113516:0:15436:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b09da6ee1ce50be 00010000:00010000:1.0:1789135861.118920:0:15436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789135861.119913:0:15436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1789135861.125123:0:15436:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1789135861.131308:0:15436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789135861.131319:0:15436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135861.131324:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135861.131326:0:15436:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789135861.131330:0:15436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789135861.131332:0:15436:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789135861.131334:0:15436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789135861.131335:0:15436:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789135861.131336:0:15436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789135861.131339:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135861.131341:0:15436:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789135861.131343:0:15436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135861.131346:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135861.131347:0:15436:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789135861.131350:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135861.131352:0:15436:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789135861.131354:0:15436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135861.131357:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135861.131358:0:15436:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789135861.131360:0:15436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135861.131363:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135861.131370:0:15436:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789135861.131374:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789135861.131410:0:15436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135861.131414:0:15436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135861.131415:0:15436:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789135861.131418:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789135861.131786:0:15422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789135861.131812:0:15422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789135861.131834:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc3a31f800/0x5b09da6ee1ce50a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50b0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135861.131845:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc3a31f800/0x5b09da6ee1ce50a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50b0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135861.131853:0:15422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc08fc4000 from 1 10000000:01000000:1.0:1789135861.131856:0:15422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135861.131889:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135861.131897:0:15422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135861.131907:0:15422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135861.131943:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789135861.132027:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.132091:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.136513:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545101056 00000100:00100000:0.0:1789135861.136535:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545101056 00000100:00100000:0.0:1789135861.137429:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135861.137443:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+14:15422:x1876044545101056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789135861.137460:0:14734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135861.137477:0:14734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce50c5 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.137503:0:14734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 15 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.137513:0:14734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 15 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.137521:0:14734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045000, rc 0) 00000100:00100000:0.0:1789135861.137603:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101056:12345-0@lo:101:mount.lustre.0 Request processed in 164us (5576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.137610:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789135861.138340:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789135861.138360:0:15422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.138370:0:15422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135861.138886:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789135861.139850:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135861.140683:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789135861.140733:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789135861.141438:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789135861.141450:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789135861.141544:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789135861.141599:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.145423:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545101184 00000100:00100000:1.0:1789135861.145434:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545101184 00000100:00100000:0.0:1789135861.145570:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789135861.145583:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135861.146793:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.147192:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101184:12345-0@lo:501:mount.lustre.0 Request processed in 1610us (5589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.147202:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789135861.147439:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135861.147492:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789135861.148212:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135861.148245:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1ff9ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.148403:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545101312 00000100:00100000:0.0:1789135861.148681:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545101312 00000100:00100000:0.0:1789135861.148732:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789135861.148741:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789135861.149733:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101312:12345-0@lo:503:mount.lustre.0 Request processed in 990us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.149759:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789135861.150510:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101312:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789135861.156711:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135861.157247:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789135861.157393:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135861.157434:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1ff9ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135861.158574:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545101440 00000100:00100000:3.0:1789135861.158585:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545101440 00000100:00100000:3.0:1789135861.158648:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789135861.158657:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789135861.159274:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101440:12345-0@lo:502:mount.lustre.0 Request processed in 617us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135861.159283:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789135861.159439:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789135861.159713:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789135861.159768:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789135861.159848:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789135861.159906:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789135861.160235:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789135861.160294:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789135861.160410:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789135861.160451:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:0.0:1789135861.160502:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:0.0:1789135861.160553:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:0.0:1789135861.160605:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:0.0:1789135861.160647:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789135861.160706:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135861.160754:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545101568 00000100:00100000:0.0:1789135861.160760:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545101568 00000100:00100000:0.0:1789135861.161202:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135861.161215:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789135861.161483:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101568:12345-0@lo:502:mount.lustre.0 Request processed in 271us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135861.161869:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135861.161895:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789135861.161998:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789135861.162014:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789135861.164420:0:15440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135861.164432:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135861.164434:0:15440:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789135861.164442:0:15440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc08fc4000 00000020:00000080:3.0:1789135861.164444:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135861.164453:0:15440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135861.164455:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135861.164456:0:15440:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789135861.164458:0:15440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135861.164460:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135861.164461:0:15440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789135861.164464:0:15440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc08fc4000 00000020:00000080:3.0:1789135861.164466:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135861.164543:0:15440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135861.164547:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135861.164548:0:15440:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789135861.164551:0:15440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135861.164553:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135861.164555:0:15440:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789135861.164558:0:15440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc08fc4000 00000020:00000080:3.0:1789135861.164560:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135861.164578:0:15440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135861.164581:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135861.164582:0:15440:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789135861.164584:0:15440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135861.164586:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135861.164587:0:15440:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789135861.164591:0:15440:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc08fc4000 00000020:00000080:3.0:1789135861.164592:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135861.164625:0:15440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135861.164628:0:15440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135861.164630:0:15440:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789135861.164633:0:15440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789135861.174875:0:15422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789135861.174915:0:15422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135861.174939:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135861.174952:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135861.174999:0:15422:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789135861.175002:0:15422:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adc08fc4000 10000000:01000000:1.0:1789135861.175006:0:15422:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adc08fc4000 10000000:01000000:1.0:1789135861.175010:0:15422:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789135861.175015:0:15422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc08fc4000 from 1 10000000:01000000:1.0:1789135861.175017:0:15422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135861.175052:0:15422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce50d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135861.175097:0:15422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce50d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135861.175948:0:15422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce50d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135861.175975:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789135861.176040:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135861.176224:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135861.176274:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545101696 00000100:00100000:0.0:1789135861.176281:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545101696 00000100:00100000:0.0:1789135861.176331:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789135861.176340:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545101696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789135861.176352:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135861.176371:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc42045400/0x5b09da6ee1ce50da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce50d3 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.176394:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc42045400/0x5b09da6ee1ce50da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50d3 expref: 16 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.176406:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc42045400/0x5b09da6ee1ce50da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50d3 expref: 16 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.176415:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc42045400, rc 0) 00000100:00100000:0.0:1789135861.176451:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545101696:12345-0@lo:101:mount.lustre.0 Request processed in 112us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.176457:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789135861.176650:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135861.176672:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789135861.176695:0:15422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce50d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50da expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135861.176704:0:15422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce50d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce50da expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135861.179649:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789135861.184248:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135861.184608:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789135861.184655:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789135861.184706:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789135861.184754:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789135861.184816:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789135861.184869:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789135861.184905:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789135861.184939:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789135861.184986:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789135861.185022:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789135861.185058:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789135861.185132:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789135861.185170:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789135861.185221:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789135861.185272:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789135861.185311:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789135861.185347:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789135861.185396:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789135861.185435:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789135861.185472:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789135861.185547:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789135861.185586:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789135861.185616:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789135861.185660:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789135861.185706:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789135861.185736:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789135861.185784:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789135861.185832:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789135861.185906:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789135861.185914:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789135861.185999:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789135861.186084:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.186124:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.189651:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545101824 00000100:00100000:0.0:1789135861.189665:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545101824 00000100:00100000:0.0:1789135861.189723:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789135861.189733:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545101824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789135861.190040:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545101824:12345-0@lo:501:mount.lustre.0 Request processed in 308us (3977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.190048:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789135861.190735:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789135861.190798:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789135861.191361:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.191398:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135861.191489:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545101952 00000100:00100000:3.0:1789135861.191495:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545101952 00000100:00100000:3.0:1789135861.191546:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135861.191555:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545101952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789135861.191719:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545101952:12345-0@lo:503:mount.lustre.0 Request processed in 166us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135861.191728:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135861.191796:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545101952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789135861.192706:0:15422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789135861.192775:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d64f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545102080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789135861.194455:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.194505:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05638540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135861.194894:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545102080 00000100:00100000:1.0:1789135861.194902:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545102080 00000100:00100000:1.0:1789135861.194960:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789135861.194970:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545102080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789135861.206284:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545102080:12345-0@lo:502:mount.lustre.0 Request processed in 11308us (11826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135861.206298:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789135861.206496:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d64f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545102080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789135861.206788:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789135861.210198:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789135861.210249:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789135861.210334:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789135861.210372:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789135861.210421:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789135861.210460:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789135861.210495:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789135861.210585:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789135861.210624:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789135861.210662:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789135861.210711:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789135861.210749:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789135861.210786:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789135861.211030:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789135861.211210:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789135861.211249:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789135861.211297:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789135861.211400:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789135861.211439:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789135861.211490:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789135861.211539:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789135861.211575:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789135861.211642:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789135861.211696:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789135861.211733:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789135861.211778:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789135861.211962:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789135861.212003:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789135861.212054:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789135861.212942:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789135861.212982:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789135861.213018:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789135861.213264:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789135861.213306:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789135861.213370:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789135861.213410:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789135861.213446:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789135861.213495:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789135861.213547:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789135861.213595:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545102208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789135861.213684:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135861.213733:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135861.213906:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545102208 00000100:00100000:2.0:1789135861.213914:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545102208 00000100:00100000:2.0:1789135861.213965:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135861.213974:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545102208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789135861.214227:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545102208:12345-0@lo:502:mount.lustre.0 Request processed in 253us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.214235:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789135861.214775:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cede00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545102208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789135861.214887:0:15422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789135861.214899:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789135861.219313:0:15445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789135861.219398:0:15445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8adc0771ced8) 00000020:00000080:3.0:1789135861.219418:0:15445:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789135861.219502:0:15445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc08fc4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789135861.219507:0:15445:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc08fc4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789135861.219510:0:15445:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc08fc4000 3 00010000:00080000:3.0:1789135861.219552:0:15445:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adc03f46000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.135@tcp at head 00010000:00010000:3.0:1789135861.225712:0:15445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789135861.225932:0:15445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789135861.225970:0:15445:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789135861.225980:0:15445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5b09da6ee1ce50e8 00000100:00080000:3.0:1789135861.225990:0:15445:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789135861.225996:0:15445:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc03f46000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135861.227919:0:15445:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc34d66940 x1876044545102336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135861.227988:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044545102336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789135861.228093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.228445:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545102336 00000100:00100000:3.0:1789135861.228453:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545102336 00000100:00100000:3.0:1789135861.228491:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135861.228505:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876044545102336:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789135861.228539:0:14744:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:3.0:1789135861.228580:0:14744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5b09da6ee1ce50ef 00000004:00100000:3.0:1789135861.228596:0:14744:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789135861.228627:0:14744:0:(import.c:65:import_set_state_nolock()) ffff8adc03f47800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135861.228688:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876044545102336:12345-0@lo:38:llog_process_th.0 Request processed in 182us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135861.228696:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789135861.228736:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc34d66940 x1876044545102336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135861.228747:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789135861.228754:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789135861.228761:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789135861.228765:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789135861.228768:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc03f46000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789135861.228773:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876044545102336:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789135861.228791:0:15445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789135861.229099:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789135861.229172:0:14302:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789135861.229175:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789135861.229178:0:14302:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789135861.229229:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545102464:0@lo:400:kworker.0 00000100:00100000:3.0:1789135861.229263:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.230980:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545102464 00000100:00100000:3.0:1789135861.230992:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545102464 00000100:00100000:3.0:1789135861.231046:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135861.231055:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545102464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135861.231431:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545102464:12345-0@lo:400:kworker.0 Request processed in 376us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135861.231453:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:2.0:1789135861.233756:0:15445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789135861.233991:0:15422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789135861.234018:0:15422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789135861.234039:0:15422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce50d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50da expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135861.234051:0:15422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01481600/0x5b09da6ee1ce50d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce50da expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789135861.234417:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789135861.234419:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789135861.234421:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789135861.234422:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789135861.234423:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789135861.234425:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789135861.234426:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789135861.234428:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789135861.234429:0:15422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789135861.234433:0:15422:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789135861.234435:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789135861.234437:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789135861.234438:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789135861.234439:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789135861.234440:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789135861.234441:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789135861.234442:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789135861.234443:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789135861.234444:0:15422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789135861.234468:0:15422:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789135861.234487:0:15422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545102592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789135861.234563:0:15422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.234597:0:15422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc07b05600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135861.234621:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545102592 00000100:00100000:1.0:1789135861.234627:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545102592 00000100:00100000:1.0:1789135861.234664:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789135861.234672:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:15422:x1876044545102592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789135861.234699:0:14736:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789135861.234712:0:14736:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789135861.240479:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc34d66940 x1876044545102464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135861.240877:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545102464:0@lo:400:kworker.0 20000000:01000000:2.0:1789135861.273425:0:14736:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789135861.273473:0:14736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789135861.275469:0:14758:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789135861.275478:0:14758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789135861.275500:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.275520:0:14758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 16 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.275545:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.275583:0:14758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 16 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135861.275596:0:14758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 16 pid: 14737 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135861.275610:0:14758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d65a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14758:1876044545102720:0@lo:104: 00000100:00100000:3.0:1789135861.275671:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135861.275755:0:14758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04691780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135861.276489:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545102720 00000100:00100000:0.0:1789135861.276496:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545102720 00000100:00100000:0.0:1789135861.276559:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135861.276569:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:14758:x1876044545102720:12345-0@lo:104: 00010000:00010000:0.0:1789135861.276583:0:14725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.276643:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135861.276649:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d643c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:14758:x1876044545102720:12345-0@lo:104: Request processed in 83us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.276655:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789135861.276674:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135861.276680:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.276687:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045a00 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:0.0:1789135861.276691:0:14730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.276716:0:14730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135861.276724:0:14730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135861.276730:0:14730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135861.276756:0:14730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.276762:0:14730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135861.276779:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.276786:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc42045a00/0x5b09da6ee1ce505c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5063 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.276815:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135861.276817:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135861.276819:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135861.276841:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545102848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135861.276873:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135861.276920:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545102848 00000100:00100000:0.0:1789135861.276924:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545102848 00010000:00010000:0.0:1789135861.276940:0:14729:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 17 pid: 14737 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135861.276961:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135861.276968:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:3313:x1876044545102848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135861.276983:0:14729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135861.276989:0:14729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 17 pid: 14737 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.276999:0:14729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 17 pid: 14737 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277014:0:14729:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277022:0:14729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789135861.277035:0:14729:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001557498s 00010000:00010000:0.0:1789135861.277039:0:14729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277046:0:14729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277052:0:14729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277058:0:14729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277093:0:14729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fe00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135861.277098:0:14729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277111:0:14729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277128:0:14729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277136:0:14729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135861.277165:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:3313:x1876044545102848:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.277173:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135861.277207:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545102848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135861.277235:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc340f3a00/0x5b09da6ee1ce5063 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce505c expref: 16 pid: 14737 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135861.277245:0:14758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d65a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14758:1876044545102720:0@lo:104: 00010000:00010000:0.0:1789135861.277258:0:14758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277266:0:14758:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277272:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135861.277277:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc3a31fe00/0x5b09da6ee1ce50f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135861.287624:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:15422:x1876044545102592:12345-0@lo:253:mount.lustre.0 Request processed in 52945us (53053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135861.287639:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135861.287745:0:15422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:15422:1876044545102592:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789135861.287761:0:15422:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789135861.287764:0:15422:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789135861.287774:0:15422:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789135861.287775:0:15422:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135861.287776:0:15422:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135861.287778:0:15422:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135861.287779:0:15422:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135861.287780:0:15422:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135861.287783:0:15422:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135861.287784:0:15422:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789135861.287799:0:15422:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789135861.299419:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789135861.299617:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789135861.299794:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789135861.300903:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789135861.301269:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789135861.301579:0:15422:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789135861.303498:0:15422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789135861.403799:0:15422:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789135861.403818:0:15422:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789135861.403847:0:15422:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789135861.403908:0:15422:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789135861.403925:0:15422:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789135861.403972:0:15422:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789135861.969157:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789135862.284575:0:14774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135862.284585:0:14774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135862.285611:0:14774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789135862.285676:0:14774:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135862.285707:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 10000000:01000000:0.0:1789135862.348313:0:14739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789135862.348320:0:14739:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc1a4e1800 from 7 10000000:01000000:0.0:1789135862.348399:0:14739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135862.348449:0:14739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135862.348461:0:14739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135862.348472:0:14739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135862.348495:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545102976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135862.348575:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135862.348623:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135862.348710:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545102976 00000100:00100000:3.0:1789135862.348791:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545102976 00000100:00100000:3.0:1789135862.348842:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135862.348851:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+15:14739:x1876044545102976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135862.348979:0:14734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135862.348993:0:14734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce50fd expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135862.349016:0:14734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 16 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135862.349025:0:14734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 16 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135862.349033:0:14734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31fa00, rc 0) 00000100:00100000:3.0:1789135862.349303:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:14739:x1876044545102976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 452us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135862.349311:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789135862.349403:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545102976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135862.349417:0:14739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135862.349426:0:14739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135862.349478:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545103104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789135862.349512:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135862.349551:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc04698cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135862.349593:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545103104 00000100:00100000:3.0:1789135862.349597:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545103104 00000100:00100000:3.0:1789135862.349627:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135862.349634:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:14739:x1876044545103104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789135862.349646:0:14734:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789135862.349661:0:14734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789135862.349664:0:14734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789135862.350279:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:14739:x1876044545103104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 643us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135862.350288:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135862.350957:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545103104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789135862.351039:0:14739:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789135862.351049:0:14739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135862.351151:0:14739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135862.990769:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135864.013809:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135865.036461:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135866.060345:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789135866.385664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789135866.385672:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789135866.385674:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789135866.385677:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789135866.385717:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135866.385737:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545103232:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.385803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.387204:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545103360:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.387258:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.387293:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135866.387301:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545103488:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.387328:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.387364:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545103232 00000100:00100000:1.0:1789135866.387371:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545103232 00000100:00100000:1.0:1789135866.387413:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135866.387421:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:3313:x1876044545103232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.387472:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:3313:x1876044545103232:12345-0@lo:400:kworker.0 Request processed in 52us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135866.387480:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135866.389223:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545103360 00000100:00100000:1.0:1789135866.389234:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545103360 00000100:00100000:1.0:1789135866.389270:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545103488 00000100:00100000:1.0:1789135866.389273:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545103488 00000100:00100000:1.0:1789135866.389296:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135866.389303:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545103360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.389372:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545103360:12345-0@lo:400:kworker.0 Request processed in 69us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135866.389378:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135866.389390:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135866.389396:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545103488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.389417:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545103488:12345-0@lo:400:kworker.0 Request processed in 22us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135866.389422:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135866.389458:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545103232:0@lo:400:kworker.0 00000100:00080000:1.0:1789135866.391743:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789135866.391792:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc3496d2c0 x1876044545103488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135866.391809:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545103488:0@lo:400:kworker.0 00010000:00080000:1.0:1789135866.391824:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc3496de00 x1876044545103360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135866.393050:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545103360:0@lo:400:kworker.0 00010000:00010000:0.0:1789135867.084683:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789135867.577385:0:15790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789135868.113722:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135869.135438:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135870.158501:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135871.180804:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789135871.500686:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789135871.500694:0:14302:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789135871.500703:0:14302:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789135871.500706:0:14302:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789135871.500753:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545103872:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.500882:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135871.500949:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545103872 00000100:00100000:0.0:1789135871.500955:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545103872 00000100:00100000:0.0:1789135871.501010:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135871.501020:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545103872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.501109:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545103872:12345-0@lo:400:kworker.0 Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135871.501117:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789135871.501208:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135871.501339:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc41cee1c0 x1876044545103872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135871.501363:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545103872:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.501771:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545103616:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.501812:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.501842:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135871.501849:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545103744:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.501874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.501913:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545103744 00000100:00100000:2.0:1789135871.501918:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545103744 00000100:00100000:2.0:1789135871.501953:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135871.501960:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545103744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.502000:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876044545103744:12345-0@lo:400:kworker.0 Request processed in 41us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.502007:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789135871.502046:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc41cefc00 x1876044545103744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135871.502081:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876044545103744:0@lo:400:kworker.0 00000100:00100000:1.0:1789135871.505333:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545103616 00000100:00100000:1.0:1789135871.505346:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545103616 00000100:00100000:1.0:1789135871.505548:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135871.505558:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:3313:x1876044545103616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135871.505656:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:3313:x1876044545103616:12345-0@lo:400:kworker.0 Request processed in 99us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135871.505665:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135871.505715:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545103616:0@lo:400:kworker.0 00010000:00010000:3.0:1789135872.204254:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789135872.526113:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789135873.228650:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789135873.766198:0:16141:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789135873.766202:0:16141:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789135873.766318:0:16141:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adc046fd800 00000020:01000004:2.0:1789135873.766335:0:16141:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789135873.766348:0:16141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789135873.766361:0:16141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8adc35093490) 00000020:00000080:2.0:1789135873.766378:0:16141:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789135873.783776:0:16141:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789135873.784221:0:16141:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789135873.785377:0:16141:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789135873.785646:0:16141:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789135873.787489:0:16141:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789135873.787863:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 424: rc = 0 00100000:10000000:2.0:1789135873.787955:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 424: rc = 0 00100000:10000000:2.0:1789135873.788055:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 424: rc = 0 00100000:10000000:2.0:1789135873.788481:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 437: rc = 0 00100000:10000000:2.0:1789135873.788729:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 437: rc = 0 00100000:10000000:2.0:1789135873.789042:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 437: rc = 0 00100000:10000000:2.0:1789135873.789303:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 437: rc = 0 00100000:10000000:2.0:1789135873.790821:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 437: rc = 0 00100000:10000000:2.0:1789135873.791420:0:16141:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 437: rc = 0 00000020:00000080:2.0:1789135873.792435:0:16141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789135873.792463:0:16141:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789135873.792473:0:16141:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b09da6ee1ce5112 00000020:01000004:2.0:1789135873.792481:0:16141:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789135873.792502:0:16141:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789135873.792506:0:16141:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789135873.792511:0:16141:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789135873.792532:0:16141:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789135873.792536:0:16141:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789135873.802384:0:16141:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789135873.802418:0:16141:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.135@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789135873.802422:0:16141:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789135873.802424:0:16141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789135873.802425:0:16141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135873.802426:0:16141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135873.802427:0:16141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135873.802428:0:16141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135873.802430:0:16141:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135873.802431:0:16141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135873.802433:0:16141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135873.802435:0:16141:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789135873.802437:0:16141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789135873.802439:0:16141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789135873.802440:0:16141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135873.802441:0:16141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135873.802442:0:16141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135873.802443:0:16141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135873.802444:0:16141:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135873.802445:0:16141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135873.802446:0:16141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135873.802494:0:16141:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789135873.802513:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789135873.802582:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.802702:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fb780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135873.802870:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545104000 00000100:00100000:1.0:1789135873.802877:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545104000 00000100:00100000:1.0:1789135873.802971:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789135873.802981:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:16141:x1876044545104000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789135873.803010:0:14734:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789135873.803013:0:14734:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789135873.803017:0:14734:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789135873.810485:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:16141:x1876044545104000:12345-0@lo:253:mount.lustre.0 Request processed in 7498us (7895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135873.810497:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789135873.810570:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789135873.810583:0:16141:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789135873.810596:0:16141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789135873.810598:0:16141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789135873.810599:0:16141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135873.810601:0:16141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135873.810602:0:16141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135873.810603:0:16141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135873.810605:0:16141:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135873.810606:0:16141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135873.810608:0:16141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789135873.810626:0:16141:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adc046fd800 from lustre-OST0001 10000000:01000000:2.0:1789135873.810647:0:16141:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789135873.810650:0:16141:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789135873.810656:0:16141:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adc04f21a48 local copy 00010000:00010000:2.0:1789135873.810722:0:16141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135873.810906:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135873.810937:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.811002:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135873.811149:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545104128 00000100:00100000:0.0:1789135873.811155:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545104128 00000100:00100000:0.0:1789135873.811222:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135873.811230:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:16141:x1876044545104128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789135873.811427:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:16141:x1876044545104128:12345-0@lo:501:mount.lustre.0 Request processed in 198us (489us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135873.811435:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789135873.811499:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104128:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789135873.811511:0:16141:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789135873.811627:0:16141:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789135873.811633:0:16141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.811642:0:16141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc42044000/0x5b09da6ee1ce4f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce4f8a expref: -99 pid: 14724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135873.811661:0:16141:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adc046fd800 10000000:01000000:2.0:1789135873.811675:0:16141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789135873.811679:0:16141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789135873.811686:0:16141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135873.811690:0:16141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789135873.811693:0:16141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789135873.811713:0:16141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f2400/0x5b09da6ee1ce5119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.811720:0:16141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc340f2400/0x5b09da6ee1ce5119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.811729:0:16141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc340f2400/0x5b09da6ee1ce5119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135873.811741:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789135873.811763:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.811901:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135873.811972:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545104256 00000100:00100000:3.0:1789135873.811976:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545104256 00000100:00100000:3.0:1789135873.811996:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789135873.812002:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:16141:x1876044545104256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789135873.812010:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135873.812021:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31e000/0x5b09da6ee1ce5120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce5119 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135873.812049:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31e000/0x5b09da6ee1ce5120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5119 expref: 17 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135873.812059:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31e000/0x5b09da6ee1ce5120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5119 expref: 17 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135873.812084:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e000, rc 0) 00000100:00100000:3.0:1789135873.812117:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104256:12345-0@lo:101:mount.lustre.0 Request processed in 116us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135873.812123:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135873.812231:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135873.812242:0:16141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc340f2400/0x5b09da6ee1ce5119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5120 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.812251:0:16141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc340f2400/0x5b09da6ee1ce5119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce5120 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135873.812927:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789135873.813953:0:16141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135873.814529:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789135873.814576:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789135873.814611:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789135873.814660:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789135873.814913:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789135873.814948:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789135873.815029:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789135873.815356:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789135873.815435:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135873.815502:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.815541:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135873.815593:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545104384 00000100:00100000:3.0:1789135873.815605:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545104384 00000100:00100000:3.0:1789135873.815649:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789135873.815658:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789135873.816421:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104384:12345-0@lo:501:mount.lustre.0 Request processed in 762us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135873.816429:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789135873.816586:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135873.816628:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789135873.816737:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.816801:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135873.816835:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545104512 00000100:00100000:0.0:1789135873.816841:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545104512 00000100:00100000:0.0:1789135873.816911:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135873.816927:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789135873.817255:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104512:12345-0@lo:503:mount.lustre.0 Request processed in 329us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135873.817330:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789135873.817418:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104512:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789135873.818401:0:16141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789135873.818483:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789135873.818535:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135873.819097:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135873.819388:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545104640 00000100:00100000:1.0:1789135873.819396:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545104640 00000100:00100000:1.0:1789135873.819431:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789135873.819440:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789135873.819767:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104640:12345-0@lo:502:mount.lustre.0 Request processed in 327us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135873.819775:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789135873.819933:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789135873.820245:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789135873.820307:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789135873.820337:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789135873.820381:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789135873.820416:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789135873.820450:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789135873.820513:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789135873.820549:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789135873.820596:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789135873.820632:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789135873.820802:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135873.820841:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc06aeb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135873.820921:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545104768 00000100:00100000:1.0:1789135873.820927:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545104768 00000100:00100000:1.0:1789135873.820967:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789135873.820974:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789135873.821430:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104768:12345-0@lo:502:mount.lustre.0 Request processed in 455us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135873.821447:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789135873.821656:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d66d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789135873.821810:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789135873.821824:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789135873.822965:0:16142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789135873.822975:0:16142:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789135873.822983:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135873.822985:0:16142:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789135873.822991:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789135873.823005:0:16142:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8adc04789a48) 00000020:00000080:0.0:1789135873.823025:0:16142:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789135873.823030:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789135873.823182:0:16142:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc046fd800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789135873.823189:0:16142:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789135873.823196:0:16142:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b09da6ee1ce512e 00010000:00010000:3.0:1789135873.833552:0:16142:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789135873.834028:0:16142:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789135873.837048:0:16142:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1789135873.839987:0:16142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789135873.840000:0:16142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135873.840006:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135873.840008:0:16142:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789135873.840012:0:16142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135873.840015:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135873.840017:0:16142:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135873.840020:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135873.840022:0:16142:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789135873.840025:0:16142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135873.840027:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135873.840028:0:16142:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789135873.840030:0:16142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135873.840033:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135873.840034:0:16142:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789135873.840037:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789135873.840167:0:16142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135873.840171:0:16142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135873.840173:0:16142:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789135873.840176:0:16142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789135873.840378:0:16141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789135873.840411:0:16141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789135873.840438:0:16141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc340f2400/0x5b09da6ee1ce5119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5120 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135873.840450:0:16141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc340f2400/0x5b09da6ee1ce5119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5120 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135873.840473:0:16141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc046fd800 from 1 10000000:01000000:0.0:1789135873.840476:0:16141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135873.840515:0:16141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135873.840529:0:16141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135873.840544:0:16141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135873.840571:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ced680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789135873.840649:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135873.840697:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03fca240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135873.840943:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545104896 00000100:00100000:1.0:1789135873.840950:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545104896 00000100:00100000:1.0:1789135873.840995:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135873.841005:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:16141:x1876044545104896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789135873.841019:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135873.841030:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce5135 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.841051:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 18 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.841096:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 18 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.841104:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc01480400, rc 0) 00000100:00100000:1.0:1789135873.841153:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545104896:12345-0@lo:101:mount.lustre.0 Request processed in 149us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135873.841160:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789135873.841608:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ced680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545104896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135873.841626:0:16141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.841636:0:16141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135873.847676:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789135873.848549:0:16141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135873.848933:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789135873.848985:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789135873.849287:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789135873.849300:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789135873.849448:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135873.849523:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.849567:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135873.849676:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545105024 00000100:00100000:0.0:1789135873.849684:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545105024 00000100:00100000:0.0:1789135873.849737:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789135873.849746:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789135873.849967:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105024:12345-0@lo:501:mount.lustre.0 Request processed in 222us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135873.849975:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789135873.850113:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789135873.850153:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789135873.850191:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.850215:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135873.850314:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545105152 00000100:00100000:0.0:1789135873.850318:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545105152 00000100:00100000:0.0:1789135873.850347:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789135873.850354:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789135873.850501:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105152:12345-0@lo:503:mount.lustre.0 Request processed in 147us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135873.850508:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789135873.850516:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789135873.851328:0:16141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135873.851408:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789135873.851452:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.851499:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135873.851664:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545105280 00000100:00100000:1.0:1789135873.851670:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545105280 00000100:00100000:1.0:1789135873.851713:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135873.851720:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789135873.851919:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105280:12345-0@lo:502:mount.lustre.0 Request processed in 199us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135873.851926:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789135873.852174:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789135873.852626:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789135873.852682:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789135873.852756:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789135873.852796:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789135873.852829:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789135873.852878:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789135873.852916:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789135873.852950:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:2.0:1789135873.853014:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:2.0:1789135873.853051:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:2.0:1789135873.853393:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:2.0:1789135873.853434:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789135873.853501:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.853582:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc119fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135873.853633:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545105408 00000100:00100000:0.0:1789135873.853639:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545105408 00000100:00100000:0.0:1789135873.853684:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789135873.853701:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789135873.853926:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105408:12345-0@lo:502:mount.lustre.0 Request processed in 226us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135873.853934:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789135873.854019:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789135873.854406:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:2.0:1789135873.854419:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789135873.855451:0:16146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135873.855472:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135873.855474:0:16146:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789135873.855480:0:16146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc046fd800 00000020:00000080:2.0:1789135873.855482:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789135873.855488:0:16146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135873.855490:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135873.855491:0:16146:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789135873.855493:0:16146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135873.855495:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135873.855496:0:16146:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135873.855499:0:16146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc046fd800 00000020:00000080:2.0:1789135873.855501:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789135873.855553:0:16146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135873.855556:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135873.855557:0:16146:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789135873.855559:0:16146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135873.855561:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135873.855562:0:16146:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789135873.855565:0:16146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc046fd800 00000020:00000080:2.0:1789135873.855567:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789135873.855581:0:16146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135873.855583:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135873.857037:0:16146:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789135873.857048:0:16146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135873.857057:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135873.857059:0:16146:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789135873.857080:0:16146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc046fd800 00000020:00000080:2.0:1789135873.857084:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789135873.857178:0:16146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135873.857182:0:16146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135873.857184:0:16146:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789135873.857187:0:16146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789135873.858813:0:16141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789135873.858847:0:16141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135873.858861:0:16141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.858874:0:16141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135873.858922:0:16141:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789135873.858925:0:16141:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adc046fd800 10000000:01000000:1.0:1789135873.858928:0:16141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adc046fd800 10000000:01000000:1.0:1789135873.858932:0:16141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789135873.858937:0:16141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc046fd800 from 1 10000000:01000000:1.0:1789135873.858946:0:16141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135873.858988:0:16141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480000/0x5b09da6ee1ce5143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.858997:0:16141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc01480000/0x5b09da6ee1ce5143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.859007:0:16141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc01480000/0x5b09da6ee1ce5143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135873.859030:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789135873.859110:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135873.859152:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91900 going to sleep for 11 seconds 00000100:00100000:2.0:1789135873.865118:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545105536 00000100:00100000:2.0:1789135873.865132:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545105536 00000100:00100000:2.0:1789135873.865189:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789135873.865200:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545105536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789135873.865216:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135873.865233:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce514a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce5143 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.865260:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce514a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5143 expref: 19 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.865271:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc340f3200/0x5b09da6ee1ce514a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5143 expref: 19 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.865281:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc340f3200, rc 0) 00000100:00100000:2.0:1789135873.865367:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545105536:12345-0@lo:101:mount.lustre.0 Request processed in 169us (6256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135873.865374:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789135873.868467:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789135873.868497:0:16141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc01480000/0x5b09da6ee1ce5143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce514a expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.868509:0:16141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc01480000/0x5b09da6ee1ce5143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce514a expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135873.870636:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789135873.872643:0:16141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135873.872944:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789135873.872990:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789135873.873710:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789135873.873774:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789135873.873812:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789135873.873862:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789135873.873899:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789135873.873933:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789135873.874186:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789135873.874429:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789135873.874480:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789135873.874538:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789135873.874574:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789135873.874609:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789135873.874655:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789135873.874689:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789135873.874720:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789135873.874763:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789135873.874793:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789135873.874820:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789135873.874861:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789135873.874891:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789135873.874918:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789135873.874960:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789135873.875157:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789135873.875197:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789135873.875437:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789135873.875506:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789135873.875542:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789135873.875610:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789135873.875647:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789135873.875678:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789135873.875708:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789135873.875750:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789135873.875783:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789135873.875828:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789135873.875865:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789135873.875955:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789135873.875962:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789135873.876546:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789135873.876623:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135873.876659:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad91900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135873.877196:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545105664 00000100:00100000:1.0:1789135873.877204:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545105664 00000100:00100000:1.0:1789135873.877261:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789135873.877391:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545105664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789135873.877671:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545105664:12345-0@lo:501:mount.lustre.0 Request processed in 401us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135873.877679:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789135873.878134:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789135873.878195:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789135873.878240:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135873.878351:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1374cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135873.878636:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545105792 00000100:00100000:1.0:1789135873.878642:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545105792 00000100:00100000:1.0:1789135873.878684:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789135873.878692:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545105792:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789135873.878839:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545105792:12345-0@lo:503:mount.lustre.0 Request processed in 148us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135873.878846:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135873.878958:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105792:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789135873.879800:0:16141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789135873.879876:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789135873.879930:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135873.879964:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1374cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135873.881137:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545105920 00000100:00100000:2.0:1789135873.881146:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545105920 00000100:00100000:2.0:1789135873.881190:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789135873.881200:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545105920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789135873.881817:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545105920:12345-0@lo:502:mount.lustre.0 Request processed in 618us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135873.881826:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135873.881906:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545105920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789135873.882329:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789135873.882382:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789135873.882418:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789135873.882481:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789135873.882533:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789135873.882578:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789135873.882610:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789135873.882640:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789135873.882686:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789135873.882723:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789135873.882757:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789135873.882803:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789135873.882850:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789135873.882881:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789135873.882927:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789135873.882958:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789135873.883139:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789135873.883195:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789135873.883232:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789135873.883343:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789135873.883414:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789135873.883467:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789135873.883506:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789135873.883556:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789135873.883593:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789135873.883626:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789135873.883668:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789135873.883698:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789135873.883725:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789135873.883765:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789135873.883796:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789135873.883823:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789135873.883850:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789135873.883890:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789135873.883920:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789135873.883961:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789135873.884148:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789135873.884782:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789135873.884842:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789135873.884876:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789135873.884918:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545106048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789135873.885052:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135873.886160:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1374cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135873.886320:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545106048 00000100:00100000:2.0:1789135873.886328:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545106048 00000100:00100000:2.0:1789135873.886373:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789135873.886382:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545106048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789135873.887347:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545106048:12345-0@lo:502:mount.lustre.0 Request processed in 963us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135873.887358:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789135873.887589:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545106048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789135873.887700:0:16141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789135873.887714:0:16141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789135873.890178:0:16152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789135873.890194:0:16152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8adc0478b490) 00000020:00000080:0.0:1789135873.890215:0:16152:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789135873.890365:0:16152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc046fd800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789135873.890369:0:16152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc046fd800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789135873.890372:0:16152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc046fd800 3 00010000:00080000:0.0:1789135873.890403:0:16152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8adb0317f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.135@tcp at head 00010000:00010000:0.0:1789135873.892975:0:16152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789135873.893188:0:16152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789135873.893222:0:16152:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789135873.893232:0:16152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5b09da6ee1ce5158 00000100:00080000:0.0:1789135873.893241:0:16152:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789135873.893246:0:16152:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adb0317f800 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:0.0:1789135873.893292:0:16152:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc41ceed00 x1876044545106176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789135873.893332:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545106176:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789135873.893398:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135873.893464:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545106176 00000100:00100000:0.0:1789135873.893470:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545106176 00000100:00100000:0.0:1789135873.893758:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135873.893765:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876044545106176:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789135873.893787:0:14744:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1789135873.893824:0:14744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5b09da6ee1ce515f 00000004:00100000:0.0:1789135873.893839:0:14744:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789135873.893868:0:14744:0:(import.c:65:import_set_state_nolock()) ffff8adb03829800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135873.893922:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876044545106176:12345-0@lo:38:llog_process_th.0 Request processed in 155us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135873.893929:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789135873.894034:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc41ceed00 x1876044545106176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135873.894044:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135873.894051:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789135873.894058:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789135873.894079:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789135873.894081:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adb0317f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789135873.894087:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876044545106176:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789135873.894106:0:16152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789135873.894126:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789135873.894130:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789135873.894133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789135873.894135:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789135873.894586:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545106304:0@lo:400:kworker.0 00000100:00100000:0.0:1789135873.894685:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135873.894728:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ced2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545106432:0@lo:400:kworker.0 00000100:00100000:0.0:1789135873.894754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135873.894782:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545106304 00000100:00100000:0.0:1789135873.894787:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545106304 00000100:00100000:0.0:1789135873.894814:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545106432 00000100:00100000:0.0:1789135873.894816:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545106432 00000100:00100000:0.0:1789135873.894837:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135873.894851:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545106304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135873.894890:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545106304:12345-0@lo:400:kworker.0 Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135873.894896:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135873.894909:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135873.894915:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545106432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135873.894942:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545106432:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135873.894947:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789135873.894963:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135873.895378:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc41ced2c0 x1876044545106432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135873.895392:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ced2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545106432:0@lo:400:kworker.0 00010000:00080000:0.0:1789135873.895426:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc41ceed00 x1876044545106304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135873.895435:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545106304:0@lo:400:kworker.0 00000040:00080000:0.0:1789135873.896164:0:16152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789135873.896205:0:16141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789135873.896235:0:16141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135873.896249:0:16141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc01480000/0x5b09da6ee1ce5143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce514a expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135873.896693:0:16141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc01480000/0x5b09da6ee1ce5143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce514a expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789135873.896735:0:16141:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789135873.896741:0:16141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135873.896742:0:16141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135873.896743:0:16141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135873.896744:0:16141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135873.896745:0:16141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135873.896746:0:16141:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135873.896748:0:16141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135873.896749:0:16141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789135873.896753:0:16141:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789135873.896755:0:16141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789135873.896756:0:16141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135873.896757:0:16141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135873.896758:0:16141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135873.896759:0:16141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135873.896760:0:16141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135873.896761:0:16141:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135873.896761:0:16141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135873.896762:0:16141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789135873.896782:0:16141:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789135873.896798:0:16141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545106560:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789135873.896851:0:16141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135873.896882:0:16141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc392f1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135873.898089:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545106560 00000100:00100000:0.0:1789135873.898099:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545106560 00000100:00100000:0.0:1789135873.898142:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789135873.898150:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:16141:x1876044545106560:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789135873.898190:0:14734:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789135873.898203:0:14734:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789135873.927180:0:14734:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789135873.927230:0:14734:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789135873.927693:0:14758:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789135873.927698:0:14758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789135873.927718:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.927749:0:14758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 19 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.927758:0:14758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.927940:0:14758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 19 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.927955:0:14758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 19 pid: 14734 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135873.927971:0:14758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14758:1876044545106688:0@lo:104: 00000100:00100000:2.0:1789135873.928031:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.928152:0:14758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc08fbdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135873.928333:0:14726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545106688 00000100:00100000:1.0:1789135873.928341:0:14726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545106688 00000100:00100000:1.0:1789135873.928389:0:14726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135873.928400:0:14726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:14758:x1876044545106688:12345-0@lo:104: 00010000:00010000:1.0:1789135873.928413:0:14726:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.928481:0:14726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135873.928487:0:14726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:14758:x1876044545106688:12345-0@lo:104: Request processed in 90us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135873.928503:0:14758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14758:1876044545106688:0@lo:104: 00000100:00100000:1.0:1789135873.928505:0:14726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789135873.928526:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135873.928532:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.928540:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:1.0:1789135873.928543:0:14731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.928557:0:14731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135873.928564:0:14731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135873.928570:0:14731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135873.928585:0:14758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.928597:0:14731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.928603:0:14731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135873.928707:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.928713:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc00030600/0x5b09da6ee1ce50fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce5104 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135873.928728:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135873.928730:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135873.928732:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135873.928745:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135873.928761:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545106816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135873.928792:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135873.928965:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545106816 00000100:00100000:2.0:1789135873.928970:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545106816 00010000:00010000:2.0:1789135873.929004:0:14729:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 20 pid: 14734 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135873.929042:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135873.929050:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+20:3313:x1876044545106816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135873.929080:0:14729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135873.929086:0:14729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 20 pid: 14734 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929096:0:14729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 20 pid: 14734 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929110:0:14729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc3a31fa00/0x5b09da6ee1ce5104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce50fd expref: 20 pid: 14734 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929122:0:14729:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929129:0:14729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789135873.929142:0:14729:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001557498s 00010000:00010000:2.0:1789135873.929146:0:14729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929154:0:14729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929169:0:14729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929175:0:14729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929187:0:14729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135873.929190:0:14729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929197:0:14729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929210:0:14729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929219:0:14729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135873.929260:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3313:x1876044545106816:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135873.929275:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135873.929304:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545106816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135873.929322:0:14758:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929339:0:14758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135873.929345:0:14758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc340f3c00/0x5b09da6ee1ce5166 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135873.941958:0:16141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:16141:1876044545106560:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789135873.941980:0:16141:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789135873.941983:0:16141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789135873.941985:0:16141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135873.941986:0:16141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135873.941987:0:16141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135873.941988:0:16141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1789135873.942106:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:16141:x1876044545106560:12345-0@lo:253:mount.lustre.0 Request processed in 43757us (45055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135873.942117:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000020:01000004:0.0:1789135873.942308:0:16141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135873.942310:0:16141:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135873.942311:0:16141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135873.942313:0:16141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789135873.942327:0:16141:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789135873.947806:0:16141:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135873.948390:0:16141:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789135873.948568:0:16141:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135873.948721:0:16141:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789135873.948994:0:16141:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1789135873.949709:0:16141:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789135873.950970:0:16141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789135874.019753:0:16141:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789135874.019763:0:16141:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789135874.019794:0:16141:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789135874.019859:0:16141:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.135@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789135874.019889:0:16141:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789135874.019916:0:16141:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789135874.252431:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135874.957140:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789135859/real 1789135859] req@ffff8adc3a2e92c0 x1876044545099648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789135874 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135874.957182:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc3a2e92c0 x1876044545099648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789135874 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135874.957203:0:3312:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789135859/real 1789135859] req@ffff8adc3a2e8780 x1876044545099776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789135874 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135874.957216:0:3312:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc3a2e8780 x1876044545099776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789135874 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789135874.957235:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc07efe000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789135874.957250:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789135874.957253:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545099648:0@lo:8:kworker.0 00000100:00080000:0.0:1789135874.957259:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc0579c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789135874.957263:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789135874.957266:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545099776:0@lo:8:kworker.0 00000100:00080000:3.0:1789135874.957834:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789135874.957839:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789135874.957848:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adc07efe000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789135874.957854:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1789135874.957859:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789135874.957865:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adc07efe000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135874.957886:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc34d64000 x1876044545107072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789135874.957903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789135874.957906:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789135874.957908:0:36:0:(import.c:65:import_set_state_nolock()) ffff8adc0579c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789135874.957911:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1789135874.957913:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789135874.957916:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adc0579c000 using connection 192.168.206.135@tcp/0@lo 00000100:00100000:3.0:1789135874.957927:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc34d661c0 x1876044545107200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135874.957986:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545107328:0@lo:400:kworker.0 00000100:00100000:2.0:1789135874.958027:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545107456:0@lo:400:kworker.0 00000100:00100000:3.0:1789135874.958049:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135874.958138:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135874.958146:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3316:1876044545106944:0@lo:400:kworker.0 00000100:00100000:3.0:1789135874.958175:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135874.958218:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545107584:0@lo:400:kworker.0 00000100:00100000:3.0:1789135874.958246:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135874.958277:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545107328 00000100:00100000:3.0:1789135874.958283:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545107328 00000100:00100000:3.0:1789135874.958328:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545107584 00000100:00100000:3.0:1789135874.958331:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545107584 00000100:00100000:3.0:1789135874.958359:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135874.958377:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545107328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135874.958428:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545107328:12345-0@lo:400:kworker.0 Request processed in 54us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135874.958435:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135874.959163:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545106944 00000100:00100000:2.0:1789135874.959171:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545106944 00000100:00100000:2.0:1789135874.959252:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135874.959260:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:3316:x1876044545106944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135874.959311:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:3316:x1876044545106944:12345-0@lo:400:kworker.0 Request processed in 52us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135874.959318:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789135874.959386:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135874.959397:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545107584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135874.959438:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545107584:12345-0@lo:400:kworker.0 Request processed in 44us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135874.959444:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135874.959477:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135874.959513:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545107456 00000100:00100000:3.0:1789135874.959517:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545107456 00000100:00100000:3.0:1789135874.959535:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789135874.959541:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545107456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135874.959576:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545107456:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135874.959582:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789135874.959601:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789135874.959628:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34d64b40 x1876044545107456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135874.959641:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545107456:0@lo:400:kworker.0 00010000:00080000:3.0:1789135874.959668:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34d65a40 x1876044545107584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135874.959695:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545107584:0@lo:400:kworker.0 00000100:00100000:3.0:1789135874.959717:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545107072:0@lo:8:kworker.0 00000100:00100000:3.0:1789135874.959761:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135874.959789:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545107200:0@lo:8:kworker.0 00000100:00100000:3.0:1789135874.959826:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135874.959883:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3316:1876044545106944:0@lo:400:kworker.0 00010000:00080000:3.0:1789135874.959905:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34d65680 x1876044545107328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135874.959915:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545107328:0@lo:400:kworker.0 00000100:00100000:3.0:1789135874.959976:0:15425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545107072 00000100:00100000:3.0:1789135874.959980:0:15425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545107072 00000100:00100000:3.0:1789135874.959997:0:15425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545107200 00000100:00100000:3.0:1789135874.960000:0:15425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545107200 00000100:00100000:3.0:1789135874.960010:0:15425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135874.960014:0:15425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1876044545107072:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789135874.960038:0:15425:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1789135874.960088:0:15425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce516d 00002000:00100000:3.0:1789135874.960103:0:15425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8adc03f40800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113983 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789135874.960108:0:15425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789135874.960111:0:15425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789135874.960472:0:15425:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789135874.960496:0:15425:0:(import.c:65:import_set_state_nolock()) ffff8adc03f47000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135874.960556:0:15425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d65a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044545107072:12345-0@lo:8:kworker.0 Request processed in 540us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135874.960564:0:15425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135874.960578:0:15425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135874.960582:0:15425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1876044545107200:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789135874.960607:0:15425:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1789135874.960623:0:15425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b09da6ee1ce5174 00002000:00100000:3.0:1789135874.960630:0:15425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8adc03f42000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113983 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789135874.960633:0:15425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789135874.960635:0:15425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789135874.960825:0:15425:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789135874.960839:0:15425:0:(import.c:65:import_set_state_nolock()) ffff8adc03f44800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135874.960869:0:15425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876044545107200:12345-0@lo:8:kworker.0 Request processed in 286us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135874.960876:0:15425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789135874.964511:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34d64000 x1876044545107072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135874.964540:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135874.964550:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789135874.964559:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789135874.964566:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789135874.964570:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc07efe000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789135874.964598:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789135874.964604:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545107072:0@lo:8:kworker.0 00010000:00080000:0.0:1789135874.964623:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34d661c0 x1876044545107200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135874.964632:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135874.964635:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789135874.964639:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789135874.964642:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789135874.964644:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8adc0579c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789135874.964654:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789135874.964657:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876044545107200:0@lo:8:kworker.0 00000004:00080000:0.0:1789135874.964736:0:14767:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789135874.964757:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ced2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14767:1876044545107840:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789135874.964824:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135874.964851:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc0540a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135874.964858:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545107840 00000100:00100000:2.0:1789135874.964868:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545107840 00000100:00100000:0.0:1789135874.964871:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545107712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135874.964900:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135874.964932:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789135874.965028:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14767:x1876044545107840:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789135874.965118:0:14764:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789135874.965569:0:14764:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 498537504959ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789135874.965593:0:14766:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789135874.965801:0:14766:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 498537737662ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789135874.965829:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545107712 00000100:00100000:1.0:1789135874.965834:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545107712 00000100:00100000:1.0:1789135874.965868:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135874.965877:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1876044545107712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135874.965897:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135874.965959:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1876044545107712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135874.965968:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:3.0:1789135874.966343:0:14765:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789135874.966365:0:14765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14765:1876044545108096:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789135874.966401:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135874.966434:0:14765:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc033ae600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135874.966544:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545107968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135874.966569:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135874.966607:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545107968 00000100:00100000:3.0:1789135874.966611:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545107968 00000100:00100000:3.0:1789135874.966640:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135874.966647:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545107968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135874.966672:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135874.966730:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876044545107968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135874.966737:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789135874.966778:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34d65680 x1876044545107968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135874.966810:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545107968:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789135874.966854:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135874.966859:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135874.966878:0:15425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789135874.966886:0:15425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1789135874.967031:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc41ceed00 x1876044545107712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135874.967059:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545107712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135874.968910:0:15426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789135874.968930:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545108096 00000100:00100000:1.0:1789135874.968936:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545108096 00002000:00080000:2.0:1789135874.970856:0:15424:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789135874.970867:0:15424:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789135874.970873:0:15424:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:1.0:1789135874.978020:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135874.978036:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14765:x1876044545108096:12345-0@lo:5:osp-pre-0-0.0 00002000:00010000:2.0:1789135874.980521:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.980531:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.980546:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.980550:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.980557:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.980574:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.980592:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.980600:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.980624:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135874.980890:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135874.980898:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.980959:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2a00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135874.980964:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.980974:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.980993:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.981001:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084564060/0x5b09da6ee1ce517b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.981020:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.981022:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.981024:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789135874.985596:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.985609:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985625:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.985631:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.985637:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985653:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985663:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985672:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985704:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135874.985723:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135874.985730:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985737:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135874.985742:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985751:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985768:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985775:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064cf029a/0x5b09da6ee1ce5182 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.985794:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135874.985796:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135874.985797:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789135874.987054:0:16217:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789135874.987084:0:16217:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789135874.987090:0:16217:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1789135874.989593:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.989605:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.989623:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.989636:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.989642:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.989656:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.989666:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.989673:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.989700:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135874.989907:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135874.989914:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.989925:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135874.989936:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.989946:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.990006:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.990015:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ad84e6/0x5b09da6ee1ce5189 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.990036:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.990038:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.990040:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789135874.991543:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.991553:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.991565:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.991569:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.991575:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.991587:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.991597:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.991613:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.991639:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135874.991805:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135874.991890:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.991902:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135874.991907:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.991918:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.991935:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.991949:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000020ab238/0x5b09da6ee1ce5190 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.991969:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.991971:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.991973:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789135874.992147:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.992153:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992162:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.992165:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.992169:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992178:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992185:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992192:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992214:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135874.992264:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135874.992271:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992278:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135874.992282:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992301:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992316:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992324:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088bfa1fd/0x5b09da6ee1ce5197 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992340:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.992342:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.992345:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789135874.992597:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.992603:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992616:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.992620:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.992624:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992634:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992642:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992649:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.992669:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135874.992702:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135874.992708:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992717:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135874.992721:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992730:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992744:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992752:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000807b660a/0x5b09da6ee1ce519e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.992770:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.992772:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.992775:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789135874.994656:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.994667:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.994681:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.994685:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.994690:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.994702:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.994723:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.994731:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.994757:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135874.994914:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135874.994923:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.994934:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3e00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135874.994939:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.994963:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.994982:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.994991:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005994c77d/0x5b09da6ee1ce51a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.995019:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.995022:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.995023:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789135874.995237:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.995243:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.995251:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.995254:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.995258:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.995268:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.995276:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.995284:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.995356:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789135874.996147:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.996155:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.996166:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.996169:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.996174:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.996183:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.996192:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.996200:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996254:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135874.996261:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996268:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f3a00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135874.996273:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996281:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996296:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996314:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caf69e7f/0x5b09da6ee1ce51ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996334:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135874.996338:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996344:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135874.996347:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996356:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996366:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996373:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.996375:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135874.996377:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135874.996586:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789135874.996591:0:15424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055b9847f/0x5b09da6ee1ce51b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135874.996932:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789135874.998610:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.998621:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.998645:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.998649:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.998655:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.998670:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.998680:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.998687:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.998751:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789135874.999292:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135874.999298:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.999307:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135874.999310:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135874.999314:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.999324:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.999344:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135874.999351:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000704:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135875.000717:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000730:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc340f2800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.000747:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000758:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000777:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000784:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007286fca6/0x5b09da6ee1ce51ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000813:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.000817:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000823:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.000826:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000833:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000848:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.000855:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.000862:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.000864:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135875.003297:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789135875.003332:0:15424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc3c1e6/0x5b09da6ee1ce51c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135875.007958:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789135875.007968:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.007983:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=498s v=(0 0) 00010000:00010000:2.0:1789135875.007988:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135875.007994:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008008:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008017:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008036:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008056:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135875.008090:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135875.008096:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008104:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135875.008109:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008118:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008136:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008144:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d04eb516/0x5b09da6ee1ce51c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135875.008169:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135875.008172:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135875.008175:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.009406:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.009754:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.009763:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.009778:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.009783:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.009790:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.009828:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.009838:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.009851:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.009867:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789135875.010355:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.010361:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010370:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.010373:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.010384:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010395:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010406:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010414:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010545:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789135875.010554:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135875.010560:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010567:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.010572:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010581:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010596:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010613:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce51cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010630:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.010634:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010640:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.010644:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010652:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010662:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010669:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce51d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.010681:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.010682:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.010684:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.011140:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.011146:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.011159:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.011162:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.011167:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.011177:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.011185:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.011194:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.011210:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135875.011424:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.011431:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.011462:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031a00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.011466:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.011475:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.011491:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.011499:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e665ef1/0x5b09da6ee1ce51dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135875.012638:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.012655:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.012667:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.012671:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.012677:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.012690:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.012714:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.012722:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.012731:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135875.012818:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.012825:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.012834:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.012838:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.012846:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.012860:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.012874:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce51e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.012894:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.012897:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.012899:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.014771:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.014782:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.014796:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.017111:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.017121:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017140:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017158:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017167:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017243:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.017256:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.017262:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017290:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.017295:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017305:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017322:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017330:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce51eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.017356:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.017358:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.017359:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.018231:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.018241:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.018254:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.018259:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.018265:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.018280:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.018290:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.018298:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.018314:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789135875.018968:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.018976:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.018991:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.018995:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.019000:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.019010:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.019019:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.019027:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.019130:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789135875.020566:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135875.020577:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020589:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.020601:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020612:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020631:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020639:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce51f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020661:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.020665:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020671:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.020675:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020682:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020692:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020698:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce51f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.020722:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.020724:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.020726:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.022408:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.022519:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.022528:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.022542:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.022547:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.022552:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.022565:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.022589:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.022597:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.022612:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.024157:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.024167:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.024179:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.024194:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.024207:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.024245:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.024253:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a56c20a5/0x5b09da6ee1ce5200 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.024294:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.024296:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.024298:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.026153:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.026166:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.026184:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.026188:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.026195:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.026210:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.026221:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.026229:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.026263:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789135875.028659:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.028674:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028692:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.028696:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.028703:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028715:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028725:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028732:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028754:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789135875.028768:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135875.028775:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028782:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ee00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.028794:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028803:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028821:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028829:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000494b3714/0x5b09da6ee1ce5207 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028849:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135875.028852:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028857:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.028860:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028867:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028876:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028884:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce520e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.028906:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.028907:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.028910:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.030122:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.030131:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030142:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.030146:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.030151:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030163:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030172:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030179:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030195:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789135875.030205:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135875.030209:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030227:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.030230:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030239:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030253:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030259:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5215 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030275:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.030277:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.030278:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.030877:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.030884:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030893:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.030896:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.030901:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030911:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030926:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030933:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030947:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789135875.030956:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135875.030961:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030967:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.030971:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030979:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030990:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.030998:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce521c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.031011:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.031017:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.031019:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.031193:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.031995:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.032010:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032022:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.032026:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.032031:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032044:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032054:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032095:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032115:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.032127:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.032132:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032140:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.032145:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032154:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032175:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032183:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce5223 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.032198:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.032200:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.032202:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.032631:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.032639:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032648:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.032652:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.032656:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032665:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032672:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032679:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032698:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789135875.032707:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135875.032712:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032719:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.032723:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032743:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032755:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032762:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce522a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.032775:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.032776:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.032778:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.033341:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.033349:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033359:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.033362:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.033367:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033377:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033385:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033393:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033419:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.033429:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.033703:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033714:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.033719:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033728:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033742:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033750:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.033771:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.033774:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.033776:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.034117:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.034124:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034134:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.034137:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.034142:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034153:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034161:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034179:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034195:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789135875.034205:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135875.034210:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034217:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.034221:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034228:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034240:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034247:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5238 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.034265:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.034266:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.034268:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.037837:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.037853:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.037869:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.037880:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.037887:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.037902:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.037913:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.037922:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.037943:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.037956:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.037961:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.037968:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.037973:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.037982:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.037999:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.038017:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce523f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.038036:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.038038:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.038039:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.038255:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.038272:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.038283:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.038287:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.038291:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.038303:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.038312:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.038319:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.038335:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789135875.038346:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135875.038351:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.038359:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fa00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.038362:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.038370:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.039512:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.039521:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5246 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.039539:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.039542:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.039544:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.041922:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:0.0:1789135875.041932:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.041935:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.041942:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.041955:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.041957:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.041962:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.041963:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.041975:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.041975:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042001:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.042004:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042021:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.042023:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042037:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.042040:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042078:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.042091:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135875.042096:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.042106:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.042111:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.042116:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.042121:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042132:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042148:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042156:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b0b607/0x5b09da6ee1ce5254 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042171:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.042173:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.042175:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.042950:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.042957:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042967:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.042970:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.042975:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.042997:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.043006:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.043013:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.043029:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.043038:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.043042:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.043048:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.043052:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.043059:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.043091:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.043098:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088a7f9f1/0x5b09da6ee1ce525b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.043119:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.043121:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.043123:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.043787:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.043795:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044688:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.044693:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.044700:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044712:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044722:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044729:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044759:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.044769:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.044773:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044793:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.044797:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044879:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044894:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135875.044896:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.044911:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5262 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.044912:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.044935:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.044939:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.044942:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.044945:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.044945:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.044948:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.044959:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.044969:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.044976:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.044999:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.045004:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.045009:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.045017:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.045022:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.045030:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.045048:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.045055:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce5269 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.045088:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.045091:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.045092:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789135875.046059:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789135875.046092:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046102:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1789135875.046106:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135875.046110:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046120:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046129:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046137:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046162:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.046172:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.046176:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046183:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.046187:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046196:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046208:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046215:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce5270 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.046230:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.046232:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.046234:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.047163:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.047174:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.047188:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.047200:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.047205:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.047217:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.047226:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.047233:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.047257:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.047364:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.047372:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.047380:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fa00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.047391:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.047401:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.047416:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.047423:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5277 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.047885:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.047888:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.047891:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.048939:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.048948:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.048961:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.048965:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.048970:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.048981:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.048989:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.049003:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.049022:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.049533:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.049541:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.049551:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.049554:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.049564:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.049579:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.049594:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f778b0a/0x5b09da6ee1ce527e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.049613:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.049615:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.049617:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135875.051623:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.051634:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.051649:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.051653:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.051659:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.051672:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.051682:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.051689:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.051710:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789135875.052146:0:15424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.052152:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.052165:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1789135875.052168:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135875.052173:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.052182:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.052191:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.052198:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.052206:0:15424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1789135875.052368:0:15424:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:1.0:1789135875.053122:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135875.053131:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053141:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.053146:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053156:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053176:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053183:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748d9cb8/0x5b09da6ee1ce5285 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053201:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.053205:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053220:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.053223:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053231:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053242:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053249:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000017a8844/0x5b09da6ee1ce528c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.053262:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.053263:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.053265:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135875.054573:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14767:x1876044545107840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89628us (89744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135875.054586:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789135875.054674:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.054683:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.054694:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31f200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.054698:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.054720:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.054736:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.054744:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b38c3b2/0x5b09da6ee1ce524d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.054764:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.054766:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.054769:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.054776:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.054779:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135875.054927:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ced2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14767:1876044545107840:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789135875.054944:0:14767:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789135875.054990:0:14767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ced2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14767:1876044545108224:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789135875.055107:0:14767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135875.055135:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545108224 00000100:00100000:1.0:1789135875.055142:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545108224 00000100:00100000:0.0:1789135875.055151:0:14767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135875.055182:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135875.055193:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ceed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14767:x1876044545108224:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789135875.055230:0:15426:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00002000:00010000:1.0:1789135875.071534:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.071547:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071564:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.071584:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.071591:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071606:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071617:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071626:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071642:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135875.071656:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.071661:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071670:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.071674:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071689:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071706:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071731:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1ac699c/0x5b09da6ee1ce5293 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.071749:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.071751:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.071753:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.072865:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.072874:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.072886:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.072890:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.072895:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.072907:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.072916:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.072923:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.072944:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135875.072956:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.073512:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.073524:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480a00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.073527:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.073536:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.073552:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.073559:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f2ebf49/0x5b09da6ee1ce529a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.073576:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.073578:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.073580:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.074260:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.074470:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.074482:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.074486:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.074491:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.074515:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.074524:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.074530:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.074551:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789135875.075216:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.075224:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075233:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.075236:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.075241:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075252:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075323:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075345:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075362:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789135875.075375:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135875.075380:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075387:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481200 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.075391:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075399:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075412:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075419:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000732ff9e7/0x5b09da6ee1ce52a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075436:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.075439:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075471:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480e00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.075475:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075483:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075494:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075502:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005933c60c/0x5b09da6ee1ce52a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.075519:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.075521:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.075523:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.075530:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.076420:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.076429:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076439:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.076443:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.076457:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076481:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076490:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076497:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076515:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135875.076526:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.076531:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076538:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481e00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.076544:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076552:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076565:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076571:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003be9d155/0x5b09da6ee1ce52af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.076597:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.076600:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.076603:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135875.076787:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ceed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14767:x1876044545108224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 21591us (21675us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789135875.076798:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789135875.077128:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789135875.077157:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789135875.077582:0:14767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ced2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14767:1876044545108224:0@lo:5:osp-pre-1-0.0 00002000:00010000:1.0:1789135875.077593:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000004:00080000:0.0:1789135875.077600:0:14767:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1789135875.077602:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077616:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.077620:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.077624:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077634:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077643:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077649:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077665:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135875.077676:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.077680:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077699:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.077702:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077711:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077723:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077730:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0fb5a82/0x5b09da6ee1ce52b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.077747:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.077749:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.077750:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.078762:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.078769:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.078780:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.078784:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.078789:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.078800:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.078815:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.078822:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.078839:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789135875.079488:0:16221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135875.079497:0:16221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.079509:0:16221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481a00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135875.079513:0:16221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.079524:0:16221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.079550:0:16221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.079557:0:16221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a394ee6/0x5b09da6ee1ce52bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.079580:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.079580:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789135875.079584:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135875.079588:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.079590:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.079599:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.079603:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.079608:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080038:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080049:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080057:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080360:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135875.080372:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.080377:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080386:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baae00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.080390:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080400:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080631:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080642:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.080660:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.080662:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.080664:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.081751:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.081762:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081774:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.081785:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.081791:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081804:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081812:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081820:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081840:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135875.081854:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.081859:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081867:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baa600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.081871:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081880:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081893:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081913:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9d4cc60/0x5b09da6ee1ce52cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.081933:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.081936:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.081939:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.082861:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.082869:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.082880:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.082884:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.082889:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.082899:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.082924:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.082931:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.082968:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789135875.083648:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.083661:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083671:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.083674:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.083678:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083687:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083694:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083700:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083716:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789135875.083730:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135875.083736:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083744:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.083748:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083756:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083775:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083782:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000871e0424/0x5b09da6ee1ce52d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083800:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.083803:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083809:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34babe00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.083811:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083817:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083826:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083832:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047369a6c/0x5b09da6ee1ce52d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.083841:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.083843:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.083849:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.083858:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.086784:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.086796:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.086809:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.086813:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.086819:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.086831:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.086840:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.086847:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.086876:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.087094:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.087103:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.087236:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baa800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.087242:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.087252:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.087283:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.087291:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a82a307/0x5b09da6ee1ce52e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.087308:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.087310:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.087312:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.088663:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.088674:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.088687:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.088690:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.088695:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.088714:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.088724:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.088731:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.088751:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789135875.089781:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.089790:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089801:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.089805:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.089809:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089819:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089827:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089846:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089868:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789135875.089884:0:16221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135875.089891:0:16221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089898:0:16221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.089903:0:16221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089912:0:16221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089928:0:16221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089935:0:16221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017946917/0x5b09da6ee1ce52e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.089952:0:16221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135875.089955:0:16221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.090213:0:16221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baac00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135875.090216:0:16221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.090223:0:16221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.090234:0:16221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.090572:0:16221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007500bdcc/0x5b09da6ee1ce52ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.090589:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.090591:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135875.090593:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.090691:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789135875.093589:0:16217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789135875.093601:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.093616:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1789135875.093620:0:16217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135875.093627:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.093639:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.093659:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.093666:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.093689:0:16217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135875.093703:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135875.093710:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.093718:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baae00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135875.093722:0:14730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.093731:0:14730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.093746:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.093753:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fa5ee29/0x5b09da6ee1ce52f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.093779:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.093781:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135875.093783:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789135875.094574:0:16217:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1789135875.094673:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14765:x1876044545108096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 116637us (128266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.094683:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135875.094735:0:14765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14765:1876044545108096:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789135875.094749:0:14765:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1789135875.094790:0:14765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14765:1876044545108352:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789135875.094823:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135875.094870:0:14765:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11937c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135875.094871:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545108352 00000100:00100000:3.0:1789135875.094879:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545108352 00000100:00100000:3.0:1789135875.094925:0:15425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135875.094935:0:15425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14765:x1876044545108352:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789135875.094972:0:15425:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1789135875.109786:0:15425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14765:x1876044545108352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14845us (14954us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789135875.109804:0:15425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135875.109994:0:14765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14765:1876044545108352:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789135875.110010:0:14765:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789135875.276552:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789135875.924271:0:14739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789135875.924278:0:14739:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc1a4e1800 from 8 10000000:01000000:0.0:1789135875.924283:0:14739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135875.924329:0:14739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031800/0x5b09da6ee1ce52fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.924342:0:14739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00031800/0x5b09da6ee1ce52fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135875.924354:0:14739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00031800/0x5b09da6ee1ce52fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135875.924378:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41ceda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545108480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135875.924454:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135875.924501:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc03f08d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135875.925652:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545108480 00000100:00100000:1.0:1789135875.925664:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545108480 00000100:00100000:1.0:1789135875.925721:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135875.925731:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:14739:x1876044545108480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135875.925757:0:14734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135875.925773:0:14734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34bab600/0x5b09da6ee1ce5303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce52fc expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.925799:0:14734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34bab600/0x5b09da6ee1ce5303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce52fc expref: 19 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.925811:0:14734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34bab600/0x5b09da6ee1ce5303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce52fc expref: 19 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.925820:0:14734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab600, rc 0) 00000100:00100000:1.0:1789135875.925875:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:14739:x1876044545108480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135875.925882:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135875.925933:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41ceda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545108480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135875.925950:0:14739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00031800/0x5b09da6ee1ce52fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5303 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135875.925959:0:14739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00031800/0x5b09da6ee1ce52fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce5303 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135875.926357:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545108608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789135875.926412:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135875.927391:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11937600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135875.927496:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545108608 00000100:00100000:2.0:1789135875.927505:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545108608 00000100:00100000:2.0:1789135875.927551:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789135875.927560:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:14739:x1876044545108608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789135875.927584:0:14736:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789135875.927600:0:14736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789135875.927603:0:14736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789135875.927725:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:14739:x1876044545108608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 166us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135875.927734:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135875.928058:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545108608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789135875.928138:0:14739:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789135875.928148:0:14739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00031800/0x5b09da6ee1ce52fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5303 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135875.928157:0:14739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00031800/0x5b09da6ee1ce52fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce5303 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135876.300478:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789135876.729523:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789135876.729537:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789135877.325314:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135878.348756:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789135879.254666:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789135879.254698:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789135879.375896:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789135880.056652:0:16501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789135880.205517:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545108864:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.205583:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135880.205635:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545109376:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.205675:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135880.205700:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789135880.205706:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3314:1876044545108736:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.205734:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135880.205756:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545109248:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.205778:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135880.205804:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545108992:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.205826:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135880.205843:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135880.205849:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc34d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545109120:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.205868:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135880.205898:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545108864 00000100:00100000:3.0:1789135880.205904:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545108864 00000100:00100000:3.0:1789135880.205952:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545108992 00000100:00100000:3.0:1789135880.205955:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545108992 00000100:00100000:3.0:1789135880.205979:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135880.205987:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545108864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206033:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545108864:12345-0@lo:400:kworker.0 Request processed in 47us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135880.206040:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135880.206056:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135880.206088:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545108992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206122:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545108992:12345-0@lo:400:kworker.0 Request processed in 60us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135880.206128:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135880.206146:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545109376 00000100:00100000:3.0:1789135880.206156:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545109376 00000100:00100000:3.0:1789135880.206176:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545109248 00000100:00100000:3.0:1789135880.206178:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545109248 00000100:00100000:3.0:1789135880.206186:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545109120 00000100:00100000:3.0:1789135880.206188:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545109120 00000100:00100000:3.0:1789135880.206199:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789135880.206204:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545109376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206235:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545109376:12345-0@lo:400:kworker.0 Request processed in 31us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135880.206241:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789135880.206253:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135880.206258:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545109248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206282:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545109248:12345-0@lo:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135880.206288:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135880.206297:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135880.206302:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545109120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206322:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545109120:12345-0@lo:400:kworker.0 Request processed in 21us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135880.206327:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135880.206344:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545108736 00000100:00100000:3.0:1789135880.206347:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545108736 00000100:00100000:3.0:1789135880.206371:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789135880.206376:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3314:x1876044545108736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206404:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3314:x1876044545108736:12345-0@lo:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135880.206410:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789135880.206460:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135880.206464:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135880.206466:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135880.206497:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34d64000 x1876044545109120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135880.206510:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545109120:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206520:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789135880.206531:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545108992:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206555:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3314:1876044545108736:0@lo:400:kworker.0 00010000:00080000:3.0:1789135880.206564:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc34d66d00 x1876044545109248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135880.206573:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545109248:0@lo:400:kworker.0 00000100:00100000:3.0:1789135880.206581:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789135880.206588:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc34d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545108864:0@lo:400:kworker.0 00010000:00080000:3.0:1789135880.206597:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc1857d2c0 x1876044545109376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135880.206605:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545109376:0@lo:400:kworker.0 00000100:00100000:1.0:1789135880.206946:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135880.206956:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545109504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135880.206988:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135880.207017:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545109504 00000100:00100000:1.0:1789135880.207021:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545109504 00000100:00100000:1.0:1789135880.207048:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135880.207055:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545109504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135880.207095:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135880.207131:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545109504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135880.207138:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135880.207169:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545109504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135880.208489:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135880.208502:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545109632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135880.208543:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135880.208579:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545109632 00000100:00100000:1.0:1789135880.208585:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545109632 00000100:00100000:1.0:1789135880.208616:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135880.208624:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545109632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135880.208648:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135880.208685:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545109632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135880.208693:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135880.208729:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545109632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789135880.396382:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135881.420287:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135882.182018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135882.182103:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512602624 00000100:00100000:0.0:1789135882.182113:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512602624 00000100:00100000:0.0:1789135882.182212:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:0.0:1789135882.182220:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2374:x1876044512602624:12345-192.168.206.35@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789135882.182248:0:14734:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 1abbebdb-1042-461e-9415-0f20361f1e33@192.168.206.35@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:0.0:1789135882.182288:0:14734:0:(genops.c:1385:class_connect()) connect: client 1abbebdb-1042-461e-9415-0f20361f1e33, cookie 0x5b09da6ee1ce530a 00000100:00080000:0.0:1789135882.182437:0:14734:0:(import.c:65:import_set_state_nolock()) ffff8adb0382b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135882.182510:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+5:2374:x1876044512602624:12345-192.168.206.35@tcp:250:mount.lustre.0 Request processed in 289us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135882.182518:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 75 00000100:00100000:1.0:1789135882.191593:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.196801:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512602752 00000100:00100000:3.0:1789135882.196816:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512602752 00000100:00100000:3.0:1789135882.196878:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:3.0:1789135882.196887:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+5:14007:x1876044512602752:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789135882.196902:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135882.196918:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31ee00/0x5b09da6ee1ce5311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d391d expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.196965:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31ee00/0x5b09da6ee1ce5311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d391d expref: 6 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.196975:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31ee00/0x5b09da6ee1ce5311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d391d expref: 6 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.196983:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31ee00, rc 0) 00000100:00100000:3.0:1789135882.197089:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+6:14007:x1876044512602752:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 175us (5476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.197096:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 76 00000100:00100000:2.0:1789135882.200162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135882.200547:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512602880 00000100:00100000:0.0:1789135882.200555:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512602880 00000100:00100000:0.0:1789135882.200617:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:0.0:1789135882.200626:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+6:14007:x1876044512602880:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789135882.200930:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+6:14007:x1876044512602880:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 304us (774us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135882.200937:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 77 00000100:00100000:1.0:1789135882.203043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135882.203146:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512603008 00000100:00100000:0.0:1789135882.203153:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512603008 00000100:00100000:0.0:1789135882.203197:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:0.0:1789135882.203206:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+6:14007:x1876044512603008:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789135882.203219:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135882.203234:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00030000/0x5b09da6ee1ce5318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3924 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135882.203261:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030000/0x5b09da6ee1ce5318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3924 expref: 7 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135882.203271:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00030000/0x5b09da6ee1ce5318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3924 expref: 7 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135882.203280:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030000, rc 0) 00000100:00100000:0.0:1789135882.203350:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+7:14007:x1876044512603008:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 137us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135882.203358:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 78 00000100:00100000:1.0:1789135882.205544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.205630:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512603136 00000100:00100000:3.0:1789135882.205638:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512603136 00000100:00100000:3.0:1789135882.205683:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:3.0:1789135882.205692:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc06b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+7:14007:x1876044512603136:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789135882.206169:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc06b27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+8:14007:x1876044512603136:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 476us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.206178:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 79 00000100:00100000:2.0:1789135882.209652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135882.209765:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512603264 00000100:00100000:1.0:1789135882.209775:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512603264 00000100:00100000:1.0:1789135882.209834:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:1.0:1789135882.209844:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc05789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+8:14007:x1876044512603264:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789135882.210191:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc05789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+8:14007:x1876044512603264:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 346us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.210200:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 80 00000100:00100000:1.0:1789135882.215211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135882.215300:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512603392 00000100:00100000:0.0:1789135882.215309:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512603392 00000100:00100000:0.0:1789135882.215356:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:0.0:1789135882.215365:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+8:14025:x1876044512603392:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135882.215693:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+8:14025:x1876044512603392:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 328us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135882.215701:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 81 00000100:00100000:2.0:1789135882.232279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.232531:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512603520 00000100:00100000:3.0:1789135882.232541:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512603520 00000100:00100000:3.0:1789135882.232606:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:3.0:1789135882.232616:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+8:14025:x1876044512603520:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135882.234204:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+8:14025:x1876044512603520:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 1584us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.234217:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 82 00000100:00100000:2.0:1789135882.237958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135882.238086:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512603648 00000100:00100000:1.0:1789135882.238094:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512603648 00000100:00100000:1.0:1789135882.238145:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:1.0:1789135882.238154:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+8:14007:x1876044512603648:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789135882.238170:0:14734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135882.238185:0:14734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34babe00/0x5b09da6ee1ce531f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d394e expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135882.238210:0:14734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34babe00/0x5b09da6ee1ce531f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d394e expref: 9 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135882.238220:0:14734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34babe00/0x5b09da6ee1ce531f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d394e expref: 9 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135882.238244:0:14734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34babe00, rc 0) 00000100:00100000:1.0:1789135882.238292:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+9:14007:x1876044512603648:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 139us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.238298:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 83 00000100:00100000:1.0:1789135882.240839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.241000:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512603776 00000100:00100000:3.0:1789135882.241021:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512603776 00000100:00100000:3.0:1789135882.241098:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:3.0:1789135882.241107:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+9:14007:x1876044512603776:12345-192.168.206.35@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789135882.241130:0:14736:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789135882.241144:0:14736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789135882.241148:0:14736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789135882.241151:0:14736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789135882.241153:0:14736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789135882.245647:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+9:14007:x1876044512603776:12345-192.168.206.35@tcp:256:mount.lustre.0 Request processed in 4531us (4807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.245662:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 84 00000100:00100000:2.0:1789135882.256137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135882.256199:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512603904 00000100:00100000:0.0:1789135882.256207:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512603904 00000100:00100000:0.0:1789135882.256260:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:0.0:1789135882.256269:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+9:14007:x1876044512603904:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789135882.256284:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135882.256300:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3955 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135882.256326:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 10 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135882.256336:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 10 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135882.256345:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030e00, rc 0) 00000100:00100000:0.0:1789135882.256396:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+10:14007:x1876044512603904:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 129us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135882.256434:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 85 00000100:00100000:1.0:1789135882.258912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.258992:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512604032 00000100:00100000:3.0:1789135882.259001:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512604032 00000100:00100000:3.0:1789135882.259055:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:3.0:1789135882.259097:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+10:14007:x1876044512604032:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789135882.259392:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+10:14007:x1876044512604032:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 328us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.259400:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 86 00000100:00100000:2.0:1789135882.272806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135882.273017:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512604160 00000100:00100000:1.0:1789135882.273026:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512604160 00000100:00100000:1.0:1789135882.273102:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:1.0:1789135882.273111:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+10:14007:x1876044512604160:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789135882.273466:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+10:14007:x1876044512604160:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 355us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.273474:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 87 00000100:00100000:2.0:1789135882.283201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135882.284273:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512604288 00000100:00100000:0.0:1789135882.284284:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512604288 00000100:00100000:0.0:1789135882.284336:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:0.0:1789135882.284345:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+10:14030:x1876044512604288:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135882.286930:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+10:14030:x1876044512604288:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 2575us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.286944:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 88 00000100:00100000:0.0:1789135882.296211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135882.296310:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512604416 00000100:00100000:1.0:1789135882.296320:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512604416 00000100:00100000:1.0:1789135882.296552:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:1.0:1789135882.296562:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+10:14030:x1876044512604416:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135882.296819:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+10:14030:x1876044512604416:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 258us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.296828:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 89 00000100:00100000:2.0:1789135882.306126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.309001:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512604544 00000100:00100000:3.0:1789135882.309013:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512604544 00000100:00100000:3.0:1789135882.309100:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:3.0:1789135882.309108:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2374:x1876044512604544:12345-192.168.206.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789135882.309136:0:14742:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 1a4aa2af-23cd-4fad-a73b-6e2cefc37572@192.168.206.35@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1789135882.309184:0:14742:0:(genops.c:1385:class_connect()) connect: client 1a4aa2af-23cd-4fad-a73b-6e2cefc37572, cookie 0x5b09da6ee1ce532d 00000004:00100000:3.0:1789135882.309459:0:14742:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789135882.309465:0:14742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789135882.353327:0:14742:0:(import.c:65:import_set_state_nolock()) ffff8adc299c8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135882.353420:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2374:x1876044512604544:12345-192.168.206.35@tcp:38:mount.lustre.0 Request processed in 44310us (47301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.353438:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:2.0:1789135882.367263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135882.367309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.369202:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512604800 00000100:00100000:3.0:1789135882.369214:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512604800 00000100:00100000:3.0:1789135882.369351:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512604672 00000100:00100000:3.0:1789135882.369355:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512604672 00000100:00100000:3.0:1789135882.369377:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:3.0:1789135882.369386:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:14007:x1876044512604800:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789135882.369447:0:14743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789135882.369566:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:14007:x1876044512604800:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 180us (2312us total) trans 0 rc 0/0 00000100:00080000:1.0:1789135882.373446:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135882.373855:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:2.0:1789135882.377240:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:2.0:1789135882.377266:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:0:x1876044512604672:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789135882.377305:0:14743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789135882.377396:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:0:x1876044512604672:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 143us (10085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135882.377430:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:0.0:1789135882.377568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135882.378211:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512604928 00000100:00100000:1.0:1789135882.378219:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512604928 00000100:00100000:1.0:1789135882.378262:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1789135882.378270:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:14007:x1876044512604928:12345-192.168.206.35@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789135882.378334:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:14007:x1876044512604928:12345-192.168.206.35@tcp:40:mount.lustre.0 Request processed in 64us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.378341:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:0.0:1789135882.380575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.380655:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512605056 00000100:00100000:3.0:1789135882.380725:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512605056 00000100:00100000:3.0:1789135882.380771:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1789135882.380779:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2374:x1876044512605056:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789135882.380807:0:15426:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 1a4aa2af-23cd-4fad-a73b-6e2cefc37572@192.168.206.35@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1789135882.380841:0:15426:0:(genops.c:1385:class_connect()) connect: client 1a4aa2af-23cd-4fad-a73b-6e2cefc37572, cookie 0x5b09da6ee1ce5334 00002000:00100000:3.0:1789135882.380852:0:15426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a4aa2af-23cd-4fad-a73b-6e2cefc37572/ffff8adc35630000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789135882.380873:0:15426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789135882.381237:0:15426:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789135882.381263:0:15426:0:(import.c:65:import_set_state_nolock()) ffff8adc35637800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135882.381369:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2374:x1876044512605056:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 589us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.381391:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:2.0:1789135882.388556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.389860:0:15425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512605184 00000100:00100000:3.0:1789135882.389873:0:15425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512605184 00000100:00100000:2.0:1789135882.389928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.389965:0:15425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:3.0:1789135882.389973:0:15425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1876044512605184:12345-192.168.206.35@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789135882.390091:0:14745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512605312 00000100:00100000:0.0:1789135882.390095:0:14745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512605312 00000100:00100000:0.0:1789135882.390132:0:14745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:0.0:1789135882.390138:0:14745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:14007:x1876044512605312:12345-192.168.206.35@tcp:33:mount.lustre.0 00010000:00080000:3.0:1789135882.390529:0:15425:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 1a4aa2af-23cd-4fad-a73b-6e2cefc37572@192.168.206.35@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1789135882.390560:0:15425:0:(genops.c:1385:class_connect()) connect: client 1a4aa2af-23cd-4fad-a73b-6e2cefc37572, cookie 0x5b09da6ee1ce533b 00002000:00100000:3.0:1789135882.390571:0:15425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1a4aa2af-23cd-4fad-a73b-6e2cefc37572/ffff8adc35633000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789135882.390593:0:15425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789135882.391399:0:15425:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789135882.391442:0:15425:0:(import.c:65:import_set_state_nolock()) ffff8adc35636800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135882.391501:0:15425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2374:x1876044512605184:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 1527us (2956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.391510:0:15425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000004:00080000:0.0:1789135882.398999:0:14745:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8787us 00000004:00200000:0.0:1789135882.422975:0:14745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1789135882.423163:0:14745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:14007:x1876044512605312:12345-192.168.206.35@tcp:33:mount.lustre.0 Request processed in 33019us (33232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135882.423174:0:14745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00010000:00010000:1.0:1789135882.445747:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135882.616709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135882.616895:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512605440 00000100:00100000:3.0:1789135882.616904:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512605440 00000100:00100000:3.0:1789135882.616969:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1789135882.616979:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:14052:x1876044512605440:12345-192.168.206.35@tcp:101:mkdir.0 00010000:00010000:3.0:1789135882.617009:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135882.617035:0:14743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce5342 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d397f expref: -99 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.617145:0:14743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce5349 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.617157:0:14743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce5349 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.617186:0:14743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce5349 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135882.617363:0:14743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789135882.617368:0:14743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135882.617472:0:14743:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce5349 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.617506:0:14743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31f200/0x5b09da6ee1ce5342 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d397f expref: 8 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.617523:0:14743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce5349 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d397f expref: 7 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135882.617531:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5200) 00010000:00010000:3.0:1789135882.617533:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135882.617537:0:14743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31fe00, rc 0) 00000100:00100000:3.0:1789135882.617600:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:14052:x1876044512605440:12345-192.168.206.35@tcp:101:mkdir.0 Request processed in 623us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.617608:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000040:00080000:0.0:1789135882.764800:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789135883.468979:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135884.395695:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a4aa2af-23cd-4fad-a73b-6e2cefc37572 00010000:00010000:1.0:1789135884.492393:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135884.576558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135884.576655:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512605568 00000100:00100000:3.0:1789135884.576665:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512605568 00000100:00100000:3.0:1789135884.576740:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:3.0:1789135884.576750:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:14105:x1876044512605568:12345-192.168.206.35@tcp:41:lfs.0 00000004:00000024:3.0:1789135884.576801:0:14742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789135884.576905:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:14105:x1876044512605568:12345-192.168.206.35@tcp:41:lfs.0 Request processed in 156us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135884.576927:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00080000:1.0:1789135884.577011:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135884.587942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.588034:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512605696 00000100:00100000:1.0:1789135884.588044:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512605696 00000100:00100000:1.0:1789135884.588169:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:1.0:1789135884.588180:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:14105:x1876044512605696:12345-192.168.206.35@tcp:13:lfs.0 00002000:00000024:1.0:1789135884.588216:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135884.588296:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:14105:x1876044512605696:12345-192.168.206.35@tcp:13:lfs.0 Request processed in 118us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135884.588305:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00080000:3.0:1789135884.588496:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135884.599674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.600107:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512605824 00000100:00100000:1.0:1789135884.600116:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512605824 00000100:00100000:1.0:1789135884.600301:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:1.0:1789135884.600312:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:14105:x1876044512605824:12345-192.168.206.35@tcp:13:lfs.0 00002000:00000024:1.0:1789135884.600352:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135884.600445:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:14105:x1876044512605824:12345-192.168.206.35@tcp:13:lfs.0 Request processed in 136us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135884.600453:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00080000:3.0:1789135884.612638:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135884.816638:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.816731:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512605952 00000100:00100000:1.0:1789135884.816749:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512605952 00000100:00100000:1.0:1789135884.816807:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 90 00000100:00100000:1.0:1789135884.816818:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+10:14138:x1876044512605952:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789135884.816834:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135884.816850:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce5350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3986 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135884.816887:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce5350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3986 expref: 11 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135884.816898:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34baac00/0x5b09da6ee1ce5350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3986 expref: 11 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135884.816908:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34baac00, rc 0) 00000100:00100000:1.0:1789135884.816963:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+11:14138:x1876044512605952:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 147us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135884.816971:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 90 00000100:00100000:0.0:1789135884.824538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.826114:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512606080 00000100:00100000:1.0:1789135884.826137:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512606080 00000100:00100000:1.0:1789135884.826211:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:1.0:1789135884.826220:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+11:14138:x1876044512606080:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789135884.827358:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+11:14138:x1876044512606080:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 1133us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135884.827369:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 91 00000100:00100000:0.0:1789135884.836638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135884.857139:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512606208 00000100:00100000:3.0:1789135884.857154:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512606208 00000100:00100000:2.0:1789135884.858620:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:2.0:1789135884.858632:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+11:14138:x1876044512606208:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789135884.859033:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+11:14138:x1876044512606208:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 401us (22404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.859042:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 92 00000100:00100000:2.0:1789135884.862516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.862618:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512606336 00000100:00100000:1.0:1789135884.862627:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512606336 00000100:00100000:1.0:1789135884.862703:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:1.0:1789135884.862712:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+11:14144:x1876044512606336:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135884.863047:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+11:14144:x1876044512606336:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 334us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135884.863056:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 93 00000100:00100000:1.0:1789135884.882831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135884.882921:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512606464 00000100:00100000:2.0:1789135884.882931:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512606464 00000100:00100000:2.0:1789135884.882986:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:2.0:1789135884.882996:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+11:14144:x1876044512606464:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135884.883275:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+11:14144:x1876044512606464:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 280us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.883284:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 94 00000100:00100000:2.0:1789135884.891249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135884.891338:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512606592 00000100:00100000:3.0:1789135884.891348:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512606592 00000100:00100000:3.0:1789135884.891411:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 95 00000100:00100000:3.0:1789135884.891421:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+11:14138:x1876044512606592:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789135884.891439:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135884.891458:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31f200/0x5b09da6ee1ce5357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d39b0 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135884.891488:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31f200/0x5b09da6ee1ce5357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b0 expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135884.891499:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31f200/0x5b09da6ee1ce5357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b0 expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135884.891508:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f200, rc 0) 00000100:00100000:3.0:1789135884.891570:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41dad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+12:14138:x1876044512606592:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 149us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135884.891578:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 95 00000100:00100000:0.0:1789135884.898176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.898277:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512606720 00000100:00100000:1.0:1789135884.898287:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512606720 00000100:00100000:1.0:1789135884.898343:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 96 00000100:00100000:1.0:1789135884.898353:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+12:14138:x1876044512606720:12345-192.168.206.35@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789135884.898379:0:14734:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789135884.898415:0:14734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789135884.898419:0:14734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789135884.898422:0:14734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789135884.898424:0:14734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789135884.901684:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+12:14138:x1876044512606720:12345-192.168.206.35@tcp:256:mount.lustre.0 Request processed in 3321us (3509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135884.901699:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 96 00000100:00100000:2.0:1789135884.905504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135884.905607:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512606848 00000100:00100000:0.0:1789135884.905617:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512606848 00000100:00100000:0.0:1789135884.905682:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 97 00000100:00100000:0.0:1789135884.905693:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+12:14138:x1876044512606848:12345-192.168.206.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789135884.905710:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135884.905736:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d39b7 expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135884.905767:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 13 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135884.905778:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 13 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135884.905788:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031e00, rc 0) 00000100:00100000:0.0:1789135884.905850:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+13:14138:x1876044512606848:12345-192.168.206.35@tcp:101:mount.lustre.0 Request processed in 159us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135884.905858:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 97 00000100:00100000:2.0:1789135884.907556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135884.909382:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512606976 00000100:00100000:0.0:1789135884.909406:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512606976 00000100:00100000:0.0:1789135884.909472:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:0.0:1789135884.909482:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+13:14138:x1876044512606976:12345-192.168.206.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789135884.909785:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+13:14138:x1876044512606976:12345-192.168.206.35@tcp:501:mount.lustre.0 Request processed in 302us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135884.909801:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 98 00000100:00100000:1.0:1789135884.912888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135884.912960:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512607104 00000100:00100000:3.0:1789135884.912969:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512607104 00000100:00100000:3.0:1789135884.913034:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:3.0:1789135884.913043:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+13:14138:x1876044512607104:12345-192.168.206.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789135884.913298:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+13:14138:x1876044512607104:12345-192.168.206.35@tcp:503:mount.lustre.0 Request processed in 254us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135884.913307:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 99 00000100:00100000:3.0:1789135884.917291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135884.917923:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512607232 00000100:00100000:2.0:1789135884.917933:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512607232 00000100:00100000:2.0:1789135884.917998:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 100 00000100:00100000:2.0:1789135884.918008:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+13:14147:x1876044512607232:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135884.918391:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+13:14147:x1876044512607232:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 384us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.918409:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 100 00000100:00100000:2.0:1789135884.921252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135884.921344:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512607360 00000100:00100000:0.0:1789135884.921353:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512607360 00000100:00100000:0.0:1789135884.921414:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 101 00000100:00100000:0.0:1789135884.921424:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+13:14147:x1876044512607360:12345-192.168.206.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135884.921680:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+13:14147:x1876044512607360:12345-192.168.206.35@tcp:502:llog_process_th.0 Request processed in 257us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135884.921688:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 101 00000100:00100000:1.0:1789135884.925359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.925416:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.925443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135884.925595:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512607872 00000100:00100000:2.0:1789135884.925604:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512607872 00000100:00100000:2.0:1789135884.925667:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512607744 00000100:00100000:2.0:1789135884.925670:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512607744 00000100:00100000:2.0:1789135884.925695:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1789135884.925705:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512607872:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135884.925776:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512607872:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 73us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.925784:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1789135884.925800:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:2.0:1789135884.925806:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2378:x1876044512607744:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135884.925831:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2378:x1876044512607744:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.925838:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:0.0:1789135884.926199:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512607616 00000100:00100000:0.0:1789135884.926204:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512607616 00000100:00100000:0.0:1789135884.926244:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:0.0:1789135884.926252:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2378:x1876044512607616:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135884.926289:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2378:x1876044512607616:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 39us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135884.926297:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:1.0:1789135884.929572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135884.929684:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512607488 00000100:00100000:2.0:1789135884.929694:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512607488 00000100:00100000:2.0:1789135884.929743:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1789135884.929751:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2374:x1876044512607488:12345-192.168.206.35@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789135884.929781:0:14743:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d5f32110-f3f1-4e5b-8f9c-f7456d1675da@192.168.206.35@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:2.0:1789135884.929817:0:14743:0:(genops.c:1385:class_connect()) connect: client d5f32110-f3f1-4e5b-8f9c-f7456d1675da, cookie 0x5b09da6ee1ce5365 00000004:00100000:2.0:1789135884.929846:0:14743:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789135884.929971:0:14743:0:(import.c:65:import_set_state_nolock()) ffff8adb02a5d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135884.930366:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:2374:x1876044512607488:12345-192.168.206.35@tcp:38:mount.lustre.0 Request processed in 493us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.930374:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1789135884.941812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135884.941853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135884.942004:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512608128 00000100:00100000:2.0:1789135884.942012:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512608128 00000100:00100000:2.0:1789135884.942102:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512608000 00000100:00100000:2.0:1789135884.942106:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512608000 00000100:00100000:2.0:1789135884.942124:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:2.0:1789135884.942132:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+7:14138:x1876044512608128:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789135884.942161:0:14742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789135884.942221:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+7:14138:x1876044512608128:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 89us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.942228:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:2.0:1789135884.942256:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:2.0:1789135884.942262:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:0:x1876044512608000:12345-192.168.206.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789135884.942274:0:14742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789135884.942294:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:0:x1876044512608000:12345-192.168.206.35@tcp:41:mount.lustre.0 Request processed in 32us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.942299:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00080000:3.0:1789135884.942827:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135884.955466:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135884.955565:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512608256 00000100:00100000:2.0:1789135884.955574:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512608256 00000100:00100000:2.0:1789135884.955633:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:2.0:1789135884.955643:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:14138:x1876044512608256:12345-192.168.206.35@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789135884.956892:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:14138:x1876044512608256:12345-192.168.206.35@tcp:40:mount.lustre.0 Request processed in 1245us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.956923:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1789135884.979512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.979552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135884.979586:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135884.979660:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512608384 00000100:00100000:0.0:1789135884.979669:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512608384 00000100:00100000:0.0:1789135884.979713:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512608512 00000100:00100000:0.0:1789135884.979717:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512608512 00000100:00100000:0.0:1789135884.979744:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1789135884.979751:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2374:x1876044512608384:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789135884.979783:0:15424:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d5f32110-f3f1-4e5b-8f9c-f7456d1675da@192.168.206.35@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:0.0:1789135884.979814:0:15424:0:(genops.c:1385:class_connect()) connect: client d5f32110-f3f1-4e5b-8f9c-f7456d1675da, cookie 0x5b09da6ee1ce536c 00002000:00100000:0.0:1789135884.979827:0:15424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d5f32110-f3f1-4e5b-8f9c-f7456d1675da/ffff8adb0317c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789135884.979853:0:15424:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789135884.979959:0:15424:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789135884.980000:0:15424:0:(import.c:65:import_set_state_nolock()) ffff8adb0317d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135884.980086:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:2374:x1876044512608384:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 312us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135884.980094:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:0.0:1789135884.980113:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:0.0:1789135884.980117:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2374:x1876044512608512:12345-192.168.206.35@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789135884.980132:0:15424:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d5f32110-f3f1-4e5b-8f9c-f7456d1675da@192.168.206.35@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:0.0:1789135884.980150:0:15424:0:(genops.c:1385:class_connect()) connect: client d5f32110-f3f1-4e5b-8f9c-f7456d1675da, cookie 0x5b09da6ee1ce5373 00002000:00100000:0.0:1789135884.980156:0:15424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d5f32110-f3f1-4e5b-8f9c-f7456d1675da/ffff8adb0317e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113983 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789135884.980162:0:15424:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789135884.980354:0:15424:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789135884.980371:0:15424:0:(import.c:65:import_set_state_nolock()) ffff8adb03179800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135884.980410:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:2374:x1876044512608512:12345-192.168.206.35@tcp:8:mount.lustre.0 Request processed in 289us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135884.980417:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1789135884.981603:0:14746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512608640 00000100:00100000:2.0:1789135884.981614:0:14746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512608640 00000100:00100000:2.0:1789135884.981667:0:14746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:2.0:1789135884.981677:0:14746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:14138:x1876044512608640:12345-192.168.206.35@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789135884.981879:0:14746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789135884.982309:0:14746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:14138:x1876044512608640:12345-192.168.206.35@tcp:33:mount.lustre.0 Request processed in 632us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135884.982317:0:14746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:1.0:1789135885.174762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135885.174860:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512608768 00000100:00100000:0.0:1789135885.174869:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512608768 00000100:00100000:0.0:1789135885.174930:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:0.0:1789135885.174941:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:14169:x1876044512608768:12345-192.168.206.35@tcp:101:mkdir.0 00010000:00010000:0.0:1789135885.174972:0:14744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135885.175005:0:14744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce537a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d39e1 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135885.175133:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135885.175147:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135885.175159:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135885.175348:0:14744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789135885.175352:0:14744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135885.175449:0:14744:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135885.175477:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce537a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 8 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135885.175494:0:14744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 7 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135885.175503:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5200) 00010000:00010000:0.0:1789135885.175506:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135885.175510:0:14744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031400, rc 0) 00000100:00100000:0.0:1789135885.175566:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+7:14169:x1876044512608768:12345-192.168.206.35@tcp:101:mkdir.0 Request processed in 627us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135885.175574:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:3.0:1789135885.324277:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545110016:0@lo:400:kworker.0 00000100:00100000:1.0:1789135885.324283:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545110144:0@lo:400:kworker.0 00000100:00100000:0.0:1789135885.324452:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3496f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545109760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135885.326416:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545110272:0@lo:400:kworker.0 00000100:00100000:3.0:1789135885.331401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135885.331466:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545110528:0@lo:400:kworker.0 00000100:00100000:3.0:1789135885.331498:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135885.331561:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545110528 00000100:00100000:3.0:1789135885.331568:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545110528 00000100:00100000:3.0:1789135885.331620:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135885.331630:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545110528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135885.331679:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876044545110528:12345-0@lo:400:kworker.0 Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135885.331686:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135885.331725:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876044545110528:0@lo:400:kworker.0 00000100:00080000:3.0:1789135885.331746:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135885.331769:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545110016 00000100:00100000:3.0:1789135885.331773:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545110016 00000100:00100000:3.0:1789135885.331802:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135885.331808:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545110016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135885.331845:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545110016:12345-0@lo:400:kworker.0 Request processed in 37us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135885.331864:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135885.333082:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545110016:0@lo:400:kworker.0 00000100:00080000:3.0:1789135885.333107:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135885.335173:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135885.335234:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545110656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135885.335287:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135885.335329:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545110656 00000100:00100000:3.0:1789135885.335337:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545110656 00000100:00100000:3.0:1789135885.335387:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789135885.335407:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545110656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135885.335434:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135885.335477:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545110656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135885.335484:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789135885.335504:0:15425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545110144 00000100:00100000:3.0:1789135885.335508:0:15425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545110144 00000100:00100000:3.0:1789135885.335539:0:15425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135885.335545:0:15425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545110144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135885.335578:0:15425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545110144:12345-0@lo:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135885.335584:0:15425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789135885.335598:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135885.335855:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545110656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135885.335869:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545110144:0@lo:400:kworker.0 00000100:00100000:0.0:1789135885.335981:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135885.336017:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545109888:0@lo:400:kworker.0 00000100:00100000:0.0:1789135885.336047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135885.336074:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545109760 00000100:00100000:3.0:1789135885.336079:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545109760 00000100:00100000:0.0:1789135885.336080:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545110400:0@lo:400:kworker.0 00000100:00100000:0.0:1789135885.336106:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135885.336109:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789135885.336115:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545109760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135885.336280:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545110400 00000100:00100000:1.0:1789135885.336284:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545110400 00000100:00100000:1.0:1789135885.336320:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135885.336327:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545110400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135885.336368:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876044545110400:12345-0@lo:400:kworker.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135885.336375:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135885.336409:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545109888 00000100:00100000:1.0:1789135885.336413:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545109888 00000100:00100000:1.0:1789135885.336438:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789135885.336445:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3313:x1876044545109888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135885.336474:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3313:x1876044545109888:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135885.336480:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789135885.336514:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:3.0:1789135885.336966:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789135885.337104:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545109760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 989us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135885.337132:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135885.337319:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3496f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545109760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135885.337330:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545109888:0@lo:400:kworker.0 00000100:00100000:0.0:1789135885.337341:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876044545110400:0@lo:400:kworker.0 00000100:00100000:2.0:1789135885.337502:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135885.338448:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545110272 00000100:00100000:3.0:1789135885.338457:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545110272 00000100:00100000:3.0:1789135885.338509:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789135885.338520:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545110272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135885.338592:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545110272:12345-0@lo:400:kworker.0 Request processed in 76us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135885.338599:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135885.338749:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545110272:0@lo:400:kworker.0 00010000:00010000:1.0:1789135885.516593:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135886.547429:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789135886.950783:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d5f32110-f3f1-4e5b-8f9c-f7456d1675da 00000001:00100000:3.0:1789135886.950799:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a4aa2af-23cd-4fad-a73b-6e2cefc37572 00000001:00100000:0.0:1789135887.414676:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d5f32110-f3f1-4e5b-8f9c-f7456d1675da 00000001:00100000:0.0:1789135887.414692:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1a4aa2af-23cd-4fad-a73b-6e2cefc37572 00010000:00010000:3.0:1789135887.564432:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789135887.912707:0:16708:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789135888.593252:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135889.494665:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d5f32110-f3f1-4e5b-8f9c-f7456d1675da 00010000:00010000:1.0:1789135889.618674:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135890.355693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135890.355732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135890.355759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135890.355787:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135890.355807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135890.355824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135890.355846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135890.355870:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512609280 00000100:00100000:3.0:1789135890.355878:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512609280 00000100:00100000:3.0:1789135890.355922:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512609536 00000100:00100000:3.0:1789135890.355925:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512609536 00000100:00100000:3.0:1789135890.355938:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512609152 00000100:00100000:3.0:1789135890.355940:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512609152 00000100:00100000:3.0:1789135890.355950:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512609664 00000100:00100000:3.0:1789135890.355952:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512609664 00000100:00100000:3.0:1789135890.355966:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1789135890.355983:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2376:x1876044512609280:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135890.356050:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2376:x1876044512609280:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 68us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.356058:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1789135890.356120:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:3.0:1789135890.356127:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2376:x1876044512609536:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135890.356236:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2376:x1876044512609536:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 108us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.356243:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:3.0:1789135890.356256:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1789135890.356263:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2376:x1876044512609152:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135890.356287:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2376:x1876044512609152:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.356294:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:3.0:1789135890.356309:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:3.0:1789135890.356315:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2376:x1876044512609664:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135890.356336:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2376:x1876044512609664:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 21us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.356341:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:3.0:1789135890.356361:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512608896 00000100:00100000:3.0:1789135890.356375:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512608896 00000100:00100000:3.0:1789135890.356399:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:3.0:1789135890.356405:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+13:2376:x1876044512608896:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135890.356434:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+13:2376:x1876044512608896:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 30us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.356441:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 103 00000100:00100000:3.0:1789135890.356469:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512609024 00000100:00100000:3.0:1789135890.356472:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512609024 00000100:00100000:3.0:1789135890.356494:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512609408 00000100:00100000:3.0:1789135890.356496:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512609408 00000100:00100000:3.0:1789135890.356507:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:3.0:1789135890.356512:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc34d661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2376:x1876044512609024:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135890.356535:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc34d661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2376:x1876044512609024:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 23us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.356541:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:3.0:1789135890.356550:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:3.0:1789135890.356555:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc194ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:2376:x1876044512609408:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:3.0:1789135890.356582:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc194ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:2376:x1876044512609408:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.356588:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00080000:1.0:1789135890.356699:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135890.356703:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135890.356706:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135890.444270:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545110784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135890.444336:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135890.444432:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545110912:0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.444453:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545111040:0@lo:400:kworker.0 00000100:00100000:0.0:1789135890.444462:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135890.444482:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135890.444485:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545111424:0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.444508:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc1857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545111168:0@lo:400:kworker.0 00000100:00100000:0.0:1789135890.444509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135890.444530:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135890.444550:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135890.444556:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545111296:0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.444577:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135890.444621:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545111424 00000100:00100000:3.0:1789135890.444627:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545111424 00000100:00100000:3.0:1789135890.444670:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545111168 00000100:00100000:3.0:1789135890.444673:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545111168 00000100:00100000:3.0:1789135890.444685:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545111296 00000100:00100000:3.0:1789135890.444687:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545111296 00000100:00100000:3.0:1789135890.444702:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135890.444710:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3496f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545111424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135890.444712:0:14742:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789135890.444719:0:14742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789135890.444776:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3496f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545111424:12345-0@lo:400:kworker.0 Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.444784:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135890.444799:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789135890.444804:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545111168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.444832:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876044545111168:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.444838:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789135890.444848:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789135890.444853:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545111296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.444878:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876044545111296:12345-0@lo:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.444884:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789135890.444904:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135890.444932:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545111424:0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.444972:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876044545111296:0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.444982:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc1857d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876044545111168:0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.445009:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545111040 00000100:00100000:3.0:1789135890.445019:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545111040 00000100:00100000:3.0:1789135890.445092:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789135890.445099:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545111040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135890.445135:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545111040:12345-0@lo:400:kworker.0 Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135890.445141:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789135890.445154:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135890.445166:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545111040:0@lo:400:kworker.0 00000100:00100000:1.0:1789135890.445259:0:15428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545110784 00000100:00100000:1.0:1789135890.445264:0:15428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545110784 00000100:00100000:1.0:1789135890.445304:0:15428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135890.445319:0:15428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545110784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135890.445347:0:15428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135890.445400:0:15428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41ceda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545110784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135890.445407:0:15428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135890.445426:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545110912 00000100:00100000:1.0:1789135890.445430:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545110912 00000100:00100000:1.0:1789135890.445453:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789135890.445459:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3313:x1876044545110912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135890.445492:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3313:x1876044545110912:12345-0@lo:400:kworker.0 Request processed in 33us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135890.445499:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789135890.445539:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc194ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545110912:0@lo:400:kworker.0 00000100:00100000:1.0:1789135890.445569:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545110784:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789135890.446015:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135890.446052:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545111552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135890.446113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135890.446178:0:15428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545111552 00000100:00100000:1.0:1789135890.446183:0:15428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545111552 00000100:00100000:1.0:1789135890.446217:0:15428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135890.446224:0:15428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545111552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135890.446245:0:15428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789135890.446374:0:15428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876044545111552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135890.446382:0:15428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135890.446429:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876044545111552:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135890.636381:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789135891.257462:0:16856:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd49cad3a0 20000000:00000080:0.0:1789135891.257479:0:16856:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc3509b000 uarg=0000000000000000 20000000:01000000:0.0:1789135891.257513:0:16856:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789135891.257524:0:16856:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789135891.257528:0:16856:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789135891.258432:0:16857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789135891.258593:0:16856:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789135891.267913:0:16856:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789135891.268006:0:16856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268025:0:16856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 18 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268033:0:16856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 18 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268040:0:16856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 18 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268050:0:16856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268057:0:16856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 12 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268094:0:16856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268205:0:16856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 12 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268222:0:16856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 12 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135891.268236:0:16856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545111680:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135891.268414:0:16856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268423:0:16856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 12 pid: 14737 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135891.268431:0:16856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346eb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545111808:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135891.268463:0:16856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 18 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268472:0:16856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 18 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135891.268480:0:16856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545111936:0@lo:104: 00000100:00100000:0.0:1789135891.268516:0:16856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135891.268547:0:16856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 18 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268556:0:16856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 18 pid: 14734 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135891.268564:0:16856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545112064:0@lo:104: 00000100:00100000:0.0:1789135891.268810:0:16856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135891.268835:0:16856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 18 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.268843:0:16856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 18 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135891.268852:0:16856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ea1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545112192:0@lo:104: 00000100:00100000:0.0:1789135891.268883:0:16856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135891.268893:0:16856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05527d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135891.269329:0:14725:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789135891.269344:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545111936 00000100:00100000:3.0:1789135891.269350:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545111936 00000100:00100000:3.0:1789135891.269410:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545112064 00000100:00100000:3.0:1789135891.269414:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545112064 00000100:00100000:3.0:1789135891.269423:0:14725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545112192 00000100:00100000:3.0:1789135891.269425:0:14725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545112192 00000100:00100000:3.0:1789135891.269437:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135891.269445:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+5:16856:x1876044545111936:12345-0@lo:104: 00010000:00010000:3.0:1789135891.269459:0:14725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135891.271965:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135891.271980:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+5:16856:x1876044545111936:12345-0@lo:104: Request processed in 2532us (3461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135891.271993:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789135891.272006:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135891.272016:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.272026:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135891.272031:0:14731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.272041:0:14731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135891.272043:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 10000000:00010000:2.0:1789135891.272053:0:14731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135891.272058:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+4:16856:x1876044545112064:12345-0@lo:104: 10000000:01000000:2.0:1789135891.272094:0:14731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135891.272097:0:14725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.272147:0:14731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.272155:0:14731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135891.272176:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.272184:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc00030400/0x5b09da6ee1ce5135 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce513c expref: -99 pid: 16141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.272197:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135891.272199:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135891.272202:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135891.272216:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135891.272234:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3316:1876044545112320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135891.272273:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135891.272335:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545112320 00000100:00100000:2.0:1789135891.272347:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545112320 00010000:00010000:2.0:1789135891.272384:0:14729:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 19 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135891.272410:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135891.272416:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3316:x1876044545112320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135891.272425:0:14729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135891.272430:0:14729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 19 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.272440:0:14729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 19 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.272456:0:14729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135891.272499:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3316:x1876044545112320:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135891.272507:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135891.272545:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3316:1876044545112320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135891.273967:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135891.273980:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+4:16856:x1876044545112064:12345-0@lo:104: Request processed in 1925us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135891.273989:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135891.274017:0:14725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789135891.274026:0:14725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc077d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:16856:x1876044545112192:12345-0@lo:104: 00010000:00010000:3.0:1789135891.274039:0:14725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135891.274103:0:14725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789135891.274108:0:14725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc077d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+3:16856:x1876044545112192:12345-0@lo:104: Request processed in 86us (5225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135891.274115:0:14725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789135891.274636:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789135891.274643:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274652:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01480800 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135891.274656:0:14730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274665:0:14730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135891.274673:0:14730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135891.274678:0:14730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135891.274719:0:14730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274726:0:14730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135891.274745:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274752:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc01480800/0x5b09da6ee1ce50c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce50cc expref: -99 pid: 15422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274763:0:14730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135891.274777:0:14730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274783:0:14730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc01481400 already unused, calling callback (ffffffffc1a63c20) 10000000:00010000:2.0:1789135891.274786:0:14730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274794:0:14730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135891.274800:0:14730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135891.274805:0:14730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135891.274820:0:14730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274826:0:14730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135891.274841:0:14730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274848:0:14730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.135@tcp lock: ffff8adc01481400/0x5b09da6ee1ce5078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b09da6ee1ce507f expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.274861:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135891.274863:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135891.274865:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135891.274873:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135891.274889:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3315:1876044545112448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135891.274930:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135891.274975:0:14728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545112448 00000100:00100000:2.0:1789135891.274987:0:14728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545112448 00010000:00010000:2.0:1789135891.275012:0:14728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 19 pid: 14734 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135891.275036:0:14728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135891.275043:0:14728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3315:x1876044545112448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135891.275054:0:14728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135891.275059:0:14728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 19 pid: 14734 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.275090:0:14728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 19 pid: 14734 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.275106:0:14728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135891.275137:0:14728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3315:x1876044545112448:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135891.275158:0:14728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135891.275194:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3315:1876044545112448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135891.275383:0:16856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545111680:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135891.277035:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135891.277057:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3314:1876044545112576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135891.277134:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135891.277482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135891.277625:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135891.280854:0:16856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346eb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545111808:192.168.206.35@tcp:104: 00010000:00010000:1.0:1789135891.280876:0:16856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc01480400/0x5b09da6ee1ce513c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce5135 expref: 18 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135891.280896:0:16856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545111936:0@lo:104: 00010000:00010000:1.0:1789135891.280908:0:16856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc42045000/0x5b09da6ee1ce50cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce50c5 expref: 17 pid: 14734 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135891.280917:0:16856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545112064:0@lo:104: 00000100:00100000:1.0:1789135891.280927:0:16856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ea1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16856:1876044545112192:0@lo:104: 00010000:00010000:1.0:1789135891.280958:0:16856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.281932:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135891.286234:0:14728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545112576 00000100:00100000:2.0:1789135891.286250:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512609792 00000100:00100000:3.0:1789135891.286252:0:14728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545112576 00000100:00100000:2.0:1789135891.286258:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512609792 00000100:00100000:1.0:1789135891.286299:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512609920 00000100:00100000:1.0:1789135891.286305:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512609920 00010000:00010000:3.0:1789135891.286681:0:14728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 17 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135891.286796:0:14728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789135891.286807:0:14728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc299c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:3314:x1876044545112576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135891.286837:0:14728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135891.286843:0:14728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 17 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135891.286854:0:14728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 17 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135891.286873:0:14728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc42045c00/0x5b09da6ee1ce507f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b09da6ee1ce5078 expref: 17 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135891.286889:0:14728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135891.287416:0:14728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc299c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:3314:x1876044545112576:12345-0@lo:103:ldlm_bl.0 Request processed in 610us (10279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135891.287424:0:14728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135891.287485:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3314:1876044545112576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135891.287581:0:14727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 14 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135891.287606:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:2.0:1789135891.287616:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1abbebdb-1042-461e-9415-0f20361f1e33+14:2375:x1876044512609792:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135891.287627:0:14727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135891.287632:0:14727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 14 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.287656:0:14727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 14 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.287669:0:14727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031e00/0x5b09da6ee1ce535e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39b7 expref: 14 pid: 14736 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.287680:0:14727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135891.287742:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1abbebdb-1042-461e-9415-0f20361f1e33+13:2375:x1876044512609792:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 129us (10127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135891.287750:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00010000:00010000:1.0:1789135891.292812:0:14729:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 12 pid: 14737 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135891.292911:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:1.0:1789135891.292932:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1abbebdb-1042-461e-9415-0f20361f1e33+12:2375:x1876044512609920:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135891.292947:0:14729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135891.292953:0:14729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 12 pid: 14737 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.292966:0:14729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 12 pid: 14737 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293005:0:14729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00030e00/0x5b09da6ee1ce5326 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3955 expref: 12 pid: 14737 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293025:0:14729:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293034:0:14729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293050:0:14729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293056:0:14729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293078:0:14729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293084:0:14729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293089:0:14729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135891.293093:0:14729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293101:0:14729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293119:0:14729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135891.293141:0:14729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135891.293202:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1abbebdb-1042-461e-9415-0f20361f1e33+11:2375:x1876044512609920:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 281us (15721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135891.293210:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00010000:00010000:0.0:1789135891.293279:0:16856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.293290:0:16856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135891.293298:0:16856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc00031600/0x5b09da6ee1ce5388 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135891.660203:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135892.343892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135892.343973:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512610048 00000100:00100000:3.0:1789135892.343983:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512610048 00000100:00100000:3.0:1789135892.344037:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 105 00000100:00100000:3.0:1789135892.344047:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+11:14021:x1876044512610048:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135892.344091:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135892.344121:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31e800/0x5b09da6ee1ce538f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d39e8 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135892.344148:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31e800/0x5b09da6ee1ce538f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e8 expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135892.344159:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31e800/0x5b09da6ee1ce538f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e8 expref: 12 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135892.344167:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e800, rc 0) 00000100:00100000:3.0:1789135892.344225:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+12:14021:x1876044512610048:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 179us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135892.344232:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 105 00000100:00100000:3.0:1789135892.357830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135892.357928:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512610176 00000100:00100000:1.0:1789135892.357938:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512610176 00000100:00100000:1.0:1789135892.357997:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 106 00000100:00100000:1.0:1789135892.358007:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+12:14021:x1876044512610176:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.358340:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+12:14021:x1876044512610176:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 333us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.358348:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 106 00000100:00100000:3.0:1789135892.360886:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135892.360969:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512610304 00000100:00100000:1.0:1789135892.360981:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512610304 00000100:00100000:1.0:1789135892.361035:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:1.0:1789135892.361046:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+12:14021:x1876044512610304:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.362005:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+12:14021:x1876044512610304:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 954us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.362018:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 107 00000100:00100000:2.0:1789135892.373947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135892.374249:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512610432 00000100:00100000:3.0:1789135892.374258:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512610432 00000100:00100000:3.0:1789135892.374314:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 108 00000100:00100000:3.0:1789135892.374323:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+12:14021:x1876044512610432:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135892.374338:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135892.374364:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc3a31f000/0x5b09da6ee1ce5396 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d39ef expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135892.374392:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc3a31f000/0x5b09da6ee1ce5396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39ef expref: 13 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135892.374403:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc3a31f000/0x5b09da6ee1ce5396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39ef expref: 13 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135892.374412:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31f000, rc 0) 00000100:00100000:3.0:1789135892.374461:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+13:14021:x1876044512610432:12345-192.168.206.35@tcp:101:ll_cfg_requeue.0 Request processed in 139us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135892.374469:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 108 00000100:00100000:2.0:1789135892.382669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135892.383560:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512610560 00000100:00100000:3.0:1789135892.383570:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512610560 00000100:00100000:3.0:1789135892.383618:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 109 00000100:00100000:3.0:1789135892.383628:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+13:14021:x1876044512610560:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135892.383891:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1abbebdb-1042-461e-9415-0f20361f1e33+13:14021:x1876044512610560:12345-192.168.206.35@tcp:501:ll_cfg_requeue.0 Request processed in 263us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135892.383900:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 109 00000100:00100000:3.0:1789135892.386986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135892.387089:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512610688 00000100:00100000:1.0:1789135892.387100:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512610688 00000100:00100000:0.0:1789135892.387316:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 110 00000100:00100000:0.0:1789135892.387328:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+13:14021:x1876044512610688:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135892.387567:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+13:14021:x1876044512610688:12345-192.168.206.35@tcp:503:ll_cfg_requeue.0 Request processed in 240us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.387575:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 110 10000000:01000000:0.0:1789135892.500222:0:14739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135892.500230:0:14739:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc046fd800 from 13 10000000:01000000:0.0:1789135892.500235:0:14739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135892.500286:0:14739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030e00/0x5b09da6ee1ce539d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135892.500299:0:14739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc00030e00/0x5b09da6ee1ce539d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135892.500321:0:14739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc00030e00/0x5b09da6ee1ce539d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135892.500345:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545112704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135892.500420:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.500506:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11b273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135892.501382:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545112704 00000100:00100000:1.0:1789135892.501391:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545112704 00000100:00100000:2.0:1789135892.501472:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789135892.501482:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3928bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+16:14739:x1876044545112704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135892.501497:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135892.501511:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc13fb3000/0x5b09da6ee1ce53a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce539d expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135892.501536:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc13fb3000/0x5b09da6ee1ce53a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce539d expref: 17 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135892.501560:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc13fb3000/0x5b09da6ee1ce53a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce539d expref: 17 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135892.501569:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3000, rc 0) 00000100:00100000:2.0:1789135892.501688:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3928bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:14739:x1876044545112704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135892.501700:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789135892.501761:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545112704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135892.501778:0:14739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc00030e00/0x5b09da6ee1ce539d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53a4 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135892.501786:0:14739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc00030e00/0x5b09da6ee1ce539d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce53a4 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135892.501847:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545112832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135892.501877:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.501912:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11b273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135892.501939:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545112832 00000100:00100000:2.0:1789135892.501944:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545112832 00000100:00100000:2.0:1789135892.501978:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789135892.501985:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc39289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:14739:x1876044545112832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135892.502465:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc39289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:14739:x1876044545112832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 479us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135892.502472:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789135892.503648:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545112832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.503703:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545112960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.503768:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135892.503804:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05527d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135892.504018:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545112960 00000100:00100000:0.0:1789135892.504024:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545112960 00000100:00100000:0.0:1789135892.504093:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789135892.504102:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:14739:x1876044545112960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135892.504279:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:14739:x1876044545112960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.504287:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789135892.504512:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545112960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789135892.506723:0:16908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789135892.516126:0:14739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789135892.516166:0:14739:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135892.516178:0:14739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc00030e00/0x5b09da6ee1ce539d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53a4 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135892.516190:0:14739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc00030e00/0x5b09da6ee1ce539d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53a4 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135892.516201:0:14739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789135892.516204:0:14739:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc08fc4000 from 13 10000000:01000000:2.0:1789135892.516207:0:14739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135892.516247:0:14739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce53ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135892.516255:0:14739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce53ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135892.516265:0:14739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce53ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135892.516311:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135892.516399:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135892.516440:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05527d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135892.516531:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545113088 00000100:00100000:1.0:1789135892.516540:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545113088 00000100:00100000:1.0:1789135892.516588:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789135892.516597:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+17:14739:x1876044545113088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135892.516611:0:14736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135892.516624:0:14736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34baa200/0x5b09da6ee1ce53b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce53ab expref: -99 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.516647:0:14736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34baa200/0x5b09da6ee1ce53b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce53ab expref: 18 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.516657:0:14736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34baa200/0x5b09da6ee1ce53b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce53ab expref: 18 pid: 14736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.516667:0:14736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34baa200, rc 0) 00000100:00100000:1.0:1789135892.516710:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:14739:x1876044545113088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.516717:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789135892.516762:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135892.516775:0:14739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce53ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53b2 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.516785:0:14739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce53ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce53b2 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135892.516833:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.516871:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135892.516891:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135892.516903:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545113216 00000100:00100000:1.0:1789135892.516906:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545113216 00000100:00100000:1.0:1789135892.516927:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789135892.516946:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:14739:x1876044545113216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.517194:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:14739:x1876044545113216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.517201:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789135892.517232:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.517260:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.517298:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135892.517311:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135892.517322:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545113344 00000100:00100000:1.0:1789135892.517325:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545113344 00000100:00100000:1.0:1789135892.517344:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789135892.517350:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:14739:x1876044545113344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.517499:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:14739:x1876044545113344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.517506:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789135892.517538:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789135892.518203:0:16909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789135892.518251:0:14739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789135892.518263:0:14739:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135892.518272:0:14739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce53ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53b2 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.518288:0:14739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc13fb2800/0x5b09da6ee1ce53ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53b2 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135892.518297:0:14739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135892.518299:0:14739:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc1a4e1800 from 13 10000000:01000000:1.0:1789135892.518302:0:14739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135892.518323:0:14739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce53b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.518331:0:14739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce53b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.518339:0:14739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce53b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135892.518366:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.518402:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135892.518419:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135892.518433:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545113472 00000100:00100000:1.0:1789135892.518438:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545113472 00000100:00100000:1.0:1789135892.518464:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789135892.518471:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+18:14739:x1876044545113472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135892.518480:0:14737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135892.518490:0:14737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc34bab800/0x5b09da6ee1ce53c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b09da6ee1ce53b9 expref: -99 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.518509:0:14737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc34bab800/0x5b09da6ee1ce53c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b09da6ee1ce53b9 expref: 19 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.518531:0:14737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc34bab800/0x5b09da6ee1ce53c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b09da6ee1ce53b9 expref: 19 pid: 14737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.518537:0:14737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab800, rc 0) 00000100:00100000:1.0:1789135892.518567:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:14739:x1876044545113472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.518573:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789135892.518605:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135892.518618:0:14739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce53b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53c0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.518627:0:14739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce53b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b09da6ee1ce53c0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135892.518664:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.518689:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135892.518701:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135892.518712:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545113600 00000100:00100000:1.0:1789135892.518715:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545113600 00000100:00100000:1.0:1789135892.518734:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789135892.518741:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:14739:x1876044545113600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.518932:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:14739:x1876044545113600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.518938:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789135892.518966:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.519002:0:14739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.519035:0:14739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135892.519048:0:14739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc046916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135892.519058:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545113728 00000100:00100000:1.0:1789135892.519084:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545113728 00000100:00100000:1.0:1789135892.519105:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789135892.519112:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:14739:x1876044545113728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135892.519230:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:14739:x1876044545113728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.519237:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789135892.519276:0:14739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:14739:1876044545113728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789135892.525038:0:16910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789135892.525202:0:14739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789135892.525220:0:14739:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135892.525230:0:14739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce53b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53c0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135892.525243:0:14739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.135@tcp lock: ffff8adc34bab000/0x5b09da6ee1ce53b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b09da6ee1ce53c0 expref: -99 pid: 14739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135892.687746:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789135893.015406:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789135893.708813:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135894.732394:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135895.054482:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.054684:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512610816 00000100:00100000:0.0:1789135895.054694:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512610816 00000100:00100000:0.0:1789135895.054798:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:0.0:1789135895.054808:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:14679:x1876044512610816:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135895.054828:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.054846:0:14742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce53c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d39f6 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.054903:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.054927:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.054939:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.054955:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.054962:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.054969:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055495:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce53dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055505:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce53dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055660:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce53dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.055752:0:14742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789135895.055756:0:14742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135895.055851:0:14742:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce53dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055863:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055869:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055875:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055880:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.055884:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055891:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.055903:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5200) 00010000:00010000:0.0:1789135895.055906:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.055911:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056048:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789135895.056248:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789135895.056290:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056311:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056317:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056322:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.056325:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056331:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056349:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8adc062d3c00) 00010000:00010000:0.0:1789135895.056352:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.056355:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056361:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056400:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce53c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39f6 expref: 8 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056414:0:14742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031600/0x5b09da6ee1ce53dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39f6 expref: 7 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.056421:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8adc062d3b00) 00010000:00010000:0.0:1789135895.056424:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135895.056433:0:14742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031600, rc 0) 00000100:00100000:0.0:1789135895.056505:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:14679:x1876044512610816:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 1697us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135895.056514:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:3.0:1789135895.064304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.064420:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512611072 00000100:00100000:0.0:1789135895.064429:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512611072 00000100:00100000:0.0:1789135895.064484:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:0.0:1789135895.064495:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:14679:x1876044512611072:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135895.064518:0:16819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.064536:0:16819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce53e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d39fd expref: -99 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.064610:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.064623:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.064633:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.064648:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.064655:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.064662:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.065199:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031a00/0x5b09da6ee1ce53f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.067458:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031a00/0x5b09da6ee1ce53f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.067473:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031a00/0x5b09da6ee1ce53f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.067490:0:16819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789135895.068028:0:16819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068037:0:16819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068044:0:16819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068050:0:16819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.068054:0:16819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068177:0:16819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068191:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8adc062d3b00) 00010000:00010000:0.0:1789135895.068194:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.068199:0:16819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068205:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce53ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068219:0:16819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068233:0:16819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068238:0:16819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068243:0:16819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.068247:0:16819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068253:0:16819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068261:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8adc062d3c00) 00010000:00010000:0.0:1789135895.068263:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.068376:0:16819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068383:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce53f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068807:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce53e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39fd expref: 10 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068823:0:16819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031a00/0x5b09da6ee1ce53f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39fd expref: 9 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.068831:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc062d3400) 00010000:00010000:0.0:1789135895.068833:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.068842:0:16819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031a00, rc 0) 00000100:00100000:0.0:1789135895.068975:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14679:x1876044512611072:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 4480us (4679us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789135895.068983:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:3.0:1789135895.076575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135895.080719:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512611200 00000100:00100000:1.0:1789135895.080739:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512611200 00000100:00100000:1.0:1789135895.080857:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:1.0:1789135895.080869:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14679:x1876044512611200:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789135895.081001:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14679:x1876044512611200:12345-192.168.206.35@tcp:59:lhsmtool_posix.0 Request processed in 134us (4435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.081010:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:3.0:1789135895.111920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.112227:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512611328 00000100:00100000:0.0:1789135895.112236:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512611328 00000100:00100000:0.0:1789135895.112358:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:0.0:1789135895.112369:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14685:x1876044512611328:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135895.112389:0:14744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.112408:0:14744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5406 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a04 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112470:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112484:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112495:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112509:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112516:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112522:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112774:0:14744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112787:0:14744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112794:0:14744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112799:0:14744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.112803:0:14744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112811:0:14744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112822:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5200) 00010000:00010000:0.0:1789135895.112825:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.112829:0:14744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112835:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce540d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112846:0:14744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112852:0:14744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112858:0:14744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112863:0:14744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.112870:0:14744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112876:0:14744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112883:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135895.112885:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.112888:0:14744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112892:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5414 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112981:0:14744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5406 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a04 expref: 10 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.112992:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5200) 00010000:00010000:0.0:1789135895.112994:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.112998:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a04 expref: 10 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.113008:0:14744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030800, rc 0) 00000100:00100000:0.0:1789135895.113112:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14685:x1876044512611328:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 697us (1152us total) trans 0 rc 301/301 00000100:00100000:0.0:1789135895.113119:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:3.0:1789135895.117226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135895.117438:0:14751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512611456 00000100:00100000:1.0:1789135895.117447:0:14751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512611456 00000100:00100000:1.0:1789135895.117489:0:14751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:1.0:1789135895.117499:0:14751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14685:x1876044512611456:12345-192.168.206.35@tcp:700:lfs.0 00000100:00100000:1.0:1789135895.117581:0:14751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14685:x1876044512611456:12345-192.168.206.35@tcp:700:lfs.0 Request processed in 84us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.117612:0:14751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:3.0:1789135895.120264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135895.120377:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512611712 00000100:00100000:1.0:1789135895.120387:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512611712 00000100:00100000:1.0:1789135895.120476:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:1.0:1789135895.120486:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14685:x1876044512611712:12345-192.168.206.35@tcp:36:lfs.0 00010000:00010000:1.0:1789135895.120544:0:14742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135895.120568:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce5349 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d397f expref: 9 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.120586:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5200) 00010000:00010000:1.0:1789135895.120591:0:14742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135895.120839:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.120852:0:14742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 5 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.120861:0:14742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.120890:0:14742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 5 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.120903:0:14742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 5 pid: 14744 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135895.120925:0:14742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14742:1876044545113856:192.168.206.35@tcp:104: 00000100:00100000:1.0:1789135895.121032:0:14742:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc41be6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135895.125818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.125819:0:14742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14742:1876044545113856:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135895.125845:0:14742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135895.125940:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512611840 00000100:00100000:2.0:1789135895.125947:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512611840 00010000:00010000:2.0:1789135895.126000:0:14727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 6 pid: 14744 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135895.126042:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00080000:3.0:1789135895.126049:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135895.126051:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:2376:x1876044512611840:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135895.126090:0:14727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135895.126157:0:14727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 6 pid: 14744 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.126170:0:14727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 6 pid: 14744 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.126192:0:14727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5381 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d39e1 expref: 6 pid: 14744 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.126207:0:14727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5200) 00010000:00010000:2.0:1789135895.126212:0:14727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.126222:0:14727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.126235:0:14727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.126355:0:14742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.126362:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.126382:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.126390:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.126398:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.126720:0:14727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135895.126871:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2376:x1876044512611840:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 819us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.126879:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000004:00200000:0.0:1789135895.128227:0:14742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789135895.128243:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.128253:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.128260:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.128526:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34baae00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.128531:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.128539:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.128568:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc02cc5200) 00010000:00010000:0.0:1789135895.128571:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.128576:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.128583:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baae00/0x5b09da6ee1ce541b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135895.128602:0:14742:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002506fe16 reply state 000000003b66d4ac transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135895.128612:0:14742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135895.128692:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+10:14685:x1876044512611712:12345-192.168.206.35@tcp:36:lfs.0 Request processed in 8204us (8630us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789135895.128701:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00010000:00010000:0.0:1789135895.130619:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.130634:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.130640:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.130646:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.130650:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.130658:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.130689:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135895.130692:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.130697:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.130703:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5422 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135895.190022:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135895.190279:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512611968 00000100:00100000:2.0:1789135895.190288:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512611968 00000100:00100000:2.0:1789135895.190355:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:2.0:1789135895.190365:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:14693:x1876044512611968:12345-192.168.206.35@tcp:101:lctl.0 00010000:00010000:2.0:1789135895.190387:0:16819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135895.190409:0:16819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2e00/0x5b09da6ee1ce5429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a0b expref: -99 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.190470:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2200/0x5b09da6ee1ce5430 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.190484:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2200/0x5b09da6ee1ce5430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.190494:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2200/0x5b09da6ee1ce5430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135895.190549:0:16819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789135895.190553:0:16819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1789135895.192713:0:16819:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2200/0x5b09da6ee1ce5430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.192790:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2e00/0x5b09da6ee1ce5429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a0b expref: 11 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.192815:0:16819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2200/0x5b09da6ee1ce5430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a0b expref: 10 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.192825:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:2.0:1789135895.192828:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135895.192832:0:16819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2200, rc 0) 00000100:00100000:2.0:1789135895.192913:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+10:14693:x1876044512611968:12345-192.168.206.35@tcp:101:lctl.0 Request processed in 2548us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.192922:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:2.0:1789135895.237989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135895.238115:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512612096 00000100:00100000:3.0:1789135895.238125:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512612096 00000100:00100000:3.0:1789135895.238175:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:3.0:1789135895.238184:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:14694:x1876044512612096:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135895.238203:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135895.238231:0:14743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce5437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a12 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.238287:0:14743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce543e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.238300:0:14743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce543e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.238311:0:14743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce543e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135895.238386:0:14743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789135895.238389:0:14743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1789135895.238410:0:14743:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce543e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.238431:0:14743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce5437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a12 expref: 7 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.238447:0:14743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e400/0x5b09da6ee1ce543e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a12 expref: 6 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.238456:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:3.0:1789135895.238459:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135895.238462:0:14743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e400, rc 0) 00000100:00100000:3.0:1789135895.238519:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:14694:x1876044512612096:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 336us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135895.238525:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 21 00000100:00100000:2.0:1789135895.243634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.243731:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512612224 00000100:00100000:0.0:1789135895.243740:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512612224 00000100:00100000:0.0:1789135895.243798:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:0.0:1789135895.243808:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:14694:x1876044512612224:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135895.243826:0:14744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.243844:0:14744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5445 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a19 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244431:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244447:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244459:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244475:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244482:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244504:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244599:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce545a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244607:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce545a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244614:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce545a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.244655:0:14744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789135895.244659:0:14744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135895.244680:0:14744:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce545a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244691:0:14744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244698:0:14744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244704:0:14744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244709:0:14744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.244714:0:14744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244719:0:14744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244751:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135895.244754:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.244758:0:14744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244764:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce544c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244776:0:14744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244782:0:14744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244787:0:14744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244792:0:14744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.244795:0:14744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244802:0:14744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244809:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135895.244811:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.244814:0:14744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244819:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5453 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244861:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce5445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a19 expref: 8 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244875:0:14744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce545a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a19 expref: 7 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.244883:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adc062d3800) 00010000:00010000:0.0:1789135895.244885:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135895.244888:0:14744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031400, rc 0) 00000100:00100000:0.0:1789135895.245761:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+7:14694:x1876044512612224:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 1951us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135895.245771:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 22 00000100:00100000:1.0:1789135895.250786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135895.250867:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512612480 00000100:00100000:3.0:1789135895.250889:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512612480 00000100:00100000:3.0:1789135895.250955:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:3.0:1789135895.250965:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+7:14694:x1876044512612480:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135895.250984:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135895.251005:0:14743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce5461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a20 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135895.251503:0:14743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789135895.251614:0:14743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce5461 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a20 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.251629:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:3.0:1789135895.251632:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135895.251637:0:14743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce5461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a20 expref: 9 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.251649:0:14743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31fa00, rc 0) 00000100:00100000:3.0:1789135895.251710:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+8:14694:x1876044512612480:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 747us (933us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789135895.251717:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 23 00000100:00100000:2.0:1789135895.263836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.264033:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512612736 00000100:00100000:0.0:1789135895.264043:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512612736 00000100:00100000:0.0:1789135895.264146:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 24 00000100:00100000:0.0:1789135895.264155:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+8:14694:x1876044512612736:12345-192.168.206.35@tcp:36:lfs.0 00010000:00010000:0.0:1789135895.264204:0:16819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135895.264231:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce545a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a19 expref: 8 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.264250:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adc062d3800) 00010000:00010000:0.0:1789135895.264260:0:16819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135895.264284:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.264295:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.264332:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135895.264555:0:16819:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ac3c38e9 reply state 00000000d504043b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135895.264564:0:16819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789135895.264579:0:16819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1789135895.264892:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+9:14694:x1876044512612736:12345-192.168.206.35@tcp:36:lfs.0 Request processed in 737us (1066us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789135895.264900:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 24 00010000:00010000:3.0:1789135895.267489:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.267507:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.267514:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.267537:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135895.267542:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.267550:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.267566:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:3.0:1789135895.267569:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789135895.267574:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.267579:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce546f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135895.268608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.269391:0:14745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512612992 00000100:00100000:0.0:1789135895.269402:0:14745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512612992 00000100:00100000:0.0:1789135895.269455:0:14745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:0.0:1789135895.269465:0:14745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+8:14694:x1876044512612992:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135895.269718:0:14745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+9:14694:x1876044512612992:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 253us (1122us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789135895.270234:0:14745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1789135895.275443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135895.275503:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512613248 00000100:00100000:3.0:1789135895.275513:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512613248 00000100:00100000:3.0:1789135895.275573:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:3.0:1789135895.275582:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+9:14694:x1876044512613248:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:3.0:1789135895.275616:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135895.275635:0:14743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce5476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a27 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275697:0:14743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275711:0:14743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275722:0:14743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275747:0:14743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275755:0:14743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275762:0:14743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135895.275886:0:14743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789135895.275971:0:14743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275979:0:14743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275986:0:14743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.275992:0:14743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135895.275996:0:14743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276003:0:14743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276014:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:3.0:1789135895.276018:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135895.276022:0:14743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276039:0:14743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce547d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276052:0:14743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276058:0:14743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276325:0:14743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276331:0:14743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31ec00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135895.276334:0:14743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276351:0:14743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276361:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adc02cc5d00) 00010000:00010000:3.0:1789135895.276364:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135895.276367:0:14743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276373:0:14743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5484 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276411:0:14743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce5476 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a27 expref: 11 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276433:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:3.0:1789135895.276436:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135895.276441:0:14743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce5476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a27 expref: 11 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.276451:0:14743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31fa00, rc 0) 00000100:00100000:3.0:1789135895.276510:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+10:14694:x1876044512613248:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 929us (1078us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789135895.276517:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 25 00000100:00100000:1.0:1789135895.287282:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.287881:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512613376 00000100:00100000:0.0:1789135895.287891:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512613376 00000100:00100000:0.0:1789135895.287966:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:0.0:1789135895.287977:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+10:14694:x1876044512613376:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135895.288000:0:16819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.288022:0:16819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5492 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a2e expref: -99 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.288161:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.288191:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.288203:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.288250:0:16819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789135895.288254:0:16819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135895.288273:0:16819:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.288303:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5492 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 12 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.288539:0:16819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 11 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.288549:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adc062d3800) 00010000:00010000:0.0:1789135895.288553:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135895.288556:0:16819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031e00, rc 0) 00000100:00100000:0.0:1789135895.288631:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+11:14694:x1876044512613376:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 656us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135895.288638:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:2.0:1789135895.306763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135895.307101:0:14746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512613504 00000100:00100000:1.0:1789135895.307113:0:14746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512613504 00000100:00100000:1.0:1789135895.307171:0:14746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:1.0:1789135895.307182:0:14746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+11:14694:x1876044512613504:12345-192.168.206.35@tcp:37:lfs.0 00000100:00100000:1.0:1789135895.316772:0:14746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+11:14694:x1876044512613504:12345-192.168.206.35@tcp:37:lfs.0 Request processed in 9583us (10011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.316785:0:14746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1789135895.327041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.327360:0:14745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512613760 00000100:00100000:0.0:1789135895.327370:0:14745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512613760 00000100:00100000:0.0:1789135895.327417:0:14745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:0.0:1789135895.327427:0:14745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc07713850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+11:14694:x1876044512613760:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135895.327692:0:14745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc07713850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+12:14694:x1876044512613760:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 265us (659us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789135895.327715:0:14745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:2.0:1789135895.439497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.439597:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512613888 00000100:00100000:0.0:1789135895.439606:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512613888 00000100:00100000:0.0:1789135895.439666:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:0.0:1789135895.439676:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+10:14700:x1876044512613888:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1789135895.439696:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.439716:0:14742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a35 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439775:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439790:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439804:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439819:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439826:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439832:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439951:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030200/0x5b09da6ee1ce54b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439977:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030200/0x5b09da6ee1ce54b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.439985:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030200/0x5b09da6ee1ce54b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.440021:0:14742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789135895.440024:0:14742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135895.440116:0:14742:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030200/0x5b09da6ee1ce54b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440128:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440135:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440141:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440148:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.440152:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440159:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440171:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135895.440175:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.440180:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440197:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440212:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440218:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440223:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440229:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.440232:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440238:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440246:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8adc062d3100) 00010000:00010000:0.0:1789135895.440249:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.440252:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440258:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440289:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a35 expref: 12 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440316:0:14742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030200/0x5b09da6ee1ce54b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a35 expref: 11 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.440323:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adc062d3800) 00010000:00010000:0.0:1789135895.440326:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789135895.440328:0:14742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030200, rc 0) 00000100:00100000:0.0:1789135895.440393:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+11:14700:x1876044512613888:12345-192.168.206.35@tcp:101:bash.0 Request processed in 719us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135895.440402:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:2.0:1789135895.448116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.448298:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512614144 00000100:00100000:0.0:1789135895.448307:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512614144 00000100:00100000:0.0:1789135895.448373:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:0.0:1789135895.448383:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+11:14700:x1876044512614144:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1789135895.448405:0:16819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.448434:0:16819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54bc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a3c expref: -99 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.448559:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.448575:0:16819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 11 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.448583:0:16819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.448616:0:16819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 11 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.448644:0:16819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 11 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135895.448658:0:16819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16819:1876044545113984:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135895.448744:0:16819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc11b27b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135895.462528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135895.463155:0:14728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512614272 00000100:00100000:3.0:1789135895.463165:0:14728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512614272 00010000:00010000:3.0:1789135895.463211:0:14728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 12 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.463257:0:14728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1789135895.463268:0:14728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+12:2376:x1876044512614272:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135895.463283:0:14728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135895.463290:0:14728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 12 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.463317:0:14728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 12 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.463351:0:14728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adc062d3800) 00010000:00010000:3.0:1789135895.463370:0:14728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.463380:0:14728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.463388:0:14728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.463408:0:14728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135895.463476:0:14728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+12:2376:x1876044512614272:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 209us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135895.463484:0:14728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00010000:00010000:0.0:1789135895.463845:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5499 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a2e expref: 11 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135895.463861:0:16819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16819:1876044545113984:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135895.463884:0:16819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.463892:0:16819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.463898:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.463934:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.463942:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.463949:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.466801:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.466834:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.466846:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.466858:0:16819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789135895.466890:0:16819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.466897:0:16819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.466903:0:16819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.466909:0:16819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.466914:0:16819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.467764:0:16819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.467782:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adc062d3800) 00010000:00010000:0.0:1789135895.467785:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.467791:0:16819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.467798:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce54c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135895.467813:0:16819:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000098edfc2c reply state 000000007c4d19de transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135895.467837:0:16819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789135895.467887:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54bc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 14 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.467905:0:16819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 13 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.467912:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135895.467914:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789135895.468054:0:16819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030800, rc 0) 00000100:00100000:0.0:1789135895.468678:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+14:14700:x1876044512614144:12345-192.168.206.35@tcp:101:bash.0 Request processed in 20293us (20567us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789135895.468688:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 28 00000100:00100000:2.0:1789135895.480705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135895.480836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135895.480857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135895.480880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135895.480900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.481293:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512614400 00000100:00100000:0.0:1789135895.481312:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512614400 00000100:00100000:0.0:1789135895.481379:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:0.0:1789135895.481390:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+13:2378:x1876044512614400:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135895.481465:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1abbebdb-1042-461e-9415-0f20361f1e33+13:2378:x1876044512614400:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 77us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135895.481473:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 120 00000100:00100000:1.0:1789135895.494505:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512614656 00000100:00100000:1.0:1789135895.494518:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512614656 00000100:00100000:1.0:1789135895.494581:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512614912 00000100:00100000:1.0:1789135895.494584:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512614912 00000100:00100000:1.0:1789135895.494598:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512614528 00000100:00100000:1.0:1789135895.494600:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512614528 00000100:00100000:1.0:1789135895.494610:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512614784 00000100:00100000:1.0:1789135895.494613:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512614784 00000100:00100000:1.0:1789135895.494629:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1789135895.494639:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512614656:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135895.494714:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512614656:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 76us (13878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.494721:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1789135895.494738:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1789135895.494758:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2378:x1876044512614912:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135895.494783:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2378:x1876044512614912:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 26us (13926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.494789:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:1.0:1789135895.494800:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1789135895.494805:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512614528:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135895.494826:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512614528:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 21us (13946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.494832:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1789135895.494841:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:1.0:1789135895.494847:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2378:x1876044512614784:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:1.0:1789135895.494865:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2378:x1876044512614784:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 19us (13965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.494870:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00080000:2.0:1789135895.495126:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135895.496247:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789135895.504546:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.504575:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.504584:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.504604:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135895.504609:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.504616:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.504631:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8adc062d3100) 00010000:00010000:0.0:1789135895.504634:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135895.504638:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.504644:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135895.512401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.512495:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512615040 00000100:00100000:0.0:1789135895.512504:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512615040 00000100:00100000:0.0:1789135895.512561:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:0.0:1789135895.512572:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+13:14700:x1876044512615040:12345-192.168.206.35@tcp:101:bash.0 00010000:00010000:0.0:1789135895.512597:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.512616:0:14742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a43 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.512683:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.512697:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.512729:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.512767:0:14742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789135895.512771:0:14742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135895.512788:0:14742:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.512798:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.512820:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 15 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.512839:0:14742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 14 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.512847:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135895.512849:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135895.512852:0:14742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031400, rc 0) 00000100:00100000:0.0:1789135895.512917:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+14:14700:x1876044512615040:12345-192.168.206.35@tcp:101:bash.0 Request processed in 346us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135895.512931:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 29 00000100:00100000:2.0:1789135895.526243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.526375:0:14745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512615296 00000100:00100000:0.0:1789135895.526384:0:14745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512615296 00000100:00100000:0.0:1789135895.526449:0:14745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1789135895.526459:0:14745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+14:14700:x1876044512615296:12345-192.168.206.35@tcp:35:bash.0 00000100:00100000:0.0:1789135895.526773:0:14745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+15:14700:x1876044512615296:12345-192.168.206.35@tcp:35:bash.0 Request processed in 315us (537us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789135895.526793:0:14745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:2.0:1789135895.564484:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545114240:0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.564551:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135895.564614:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545114752:0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.564643:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135895.564671:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135895.564677:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545114368:0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.564698:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135895.564714:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545114880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135895.564735:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135895.564766:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545114240 00000100:00100000:2.0:1789135895.564772:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545114240 00000100:00100000:2.0:1789135895.564814:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545114368 00000100:00100000:2.0:1789135895.564817:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545114368 00000100:00100000:2.0:1789135895.564833:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135895.564840:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545114240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.564887:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545114240:12345-0@lo:400:kworker.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.564894:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135895.564908:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789135895.564913:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545114368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.564953:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545114368:12345-0@lo:400:kworker.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.564959:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789135895.564994:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545114880 00000100:00100000:2.0:1789135895.565002:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545114880 00000100:00100000:2.0:1789135895.565029:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135895.565036:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545114880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135895.565086:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135895.565118:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545114880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.565124:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135895.565174:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545114368:0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.565189:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545114880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135895.565197:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545114240:0@lo:400:kworker.0 00000100:00080000:2.0:1789135895.565221:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135895.565224:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135895.565234:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545114752 00000100:00100000:2.0:1789135895.565237:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545114752 00000100:00100000:2.0:1789135895.565266:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135895.565272:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545114752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.565305:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876044545114752:12345-0@lo:400:kworker.0 Request processed in 33us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.565311:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135895.565334:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876044545114752:0@lo:400:kworker.0 00000100:00080000:2.0:1789135895.565359:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135895.565628:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3314:1876044545114112:0@lo:400:kworker.0 00000100:00100000:0.0:1789135895.565667:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135895.565697:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545114624:0@lo:400:kworker.0 00000100:00100000:0.0:1789135895.565723:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135895.565743:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135895.565749:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc345d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545114496:0@lo:400:kworker.0 00000100:00100000:0.0:1789135895.565770:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135895.565800:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545114624 00000100:00100000:0.0:1789135895.565803:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545114624 00000100:00100000:0.0:1789135895.565828:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545114496 00000100:00100000:0.0:1789135895.565831:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545114496 00000100:00100000:0.0:1789135895.565844:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789135895.565850:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545114624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135895.565885:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876044545114624:12345-0@lo:400:kworker.0 Request processed in 35us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135895.565892:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789135895.565905:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135895.565910:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545114496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135895.565951:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876044545114496:12345-0@lo:400:kworker.0 Request processed in 41us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135895.565957:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135895.565981:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876044545114496:0@lo:400:kworker.0 00000100:00100000:0.0:1789135895.565990:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876044545114624:0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.566208:0:14734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545114112 00000100:00100000:2.0:1789135895.566212:0:14734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545114112 00000100:00100000:2.0:1789135895.566243:0:14734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789135895.566250:0:14734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3314:x1876044545114112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.566282:0:14734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3314:x1876044545114112:12345-0@lo:400:kworker.0 Request processed in 32us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.566294:0:14734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1789135895.566316:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135895.568728:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545115008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135895.568797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135895.569362:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc345d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3314:1876044545114112:0@lo:400:kworker.0 00000100:00100000:2.0:1789135895.570641:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545115008 00000100:00100000:2.0:1789135895.570651:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545115008 00000100:00100000:2.0:1789135895.570713:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135895.570722:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545115008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135895.570756:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135895.570836:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545115008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.570843:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135895.570963:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545115008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135895.625171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.625317:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512615552 00000100:00100000:0.0:1789135895.625328:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512615552 00000100:00100000:0.0:1789135895.625412:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:0.0:1789135895.625423:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+15:14710:x1876044512615552:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135895.625447:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.625469:0:14743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a4a expref: -99 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.625578:0:14743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789135895.625700:0:14743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a4a expref: 17 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.625714:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc1171a900) 00010000:00010000:0.0:1789135895.625717:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135895.625722:0:14743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a4a expref: 17 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.625735:0:14743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030400, rc 0) 00000100:00100000:0.0:1789135895.625791:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+16:14710:x1876044512615552:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 371us (630us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789135895.625798:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 30 00000100:00100000:2.0:1789135895.643263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.643418:0:14745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512615808 00000100:00100000:0.0:1789135895.643428:0:14745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512615808 00000100:00100000:0.0:1789135895.643486:0:14745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:0.0:1789135895.643510:0:14745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+16:14710:x1876044512615808:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:0.0:1789135895.643768:0:14745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+17:14710:x1876044512615808:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 260us (513us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789135895.643777:0:14745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:2.0:1789135895.698911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135895.699137:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512616064 00000100:00100000:0.0:1789135895.699146:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512616064 00000100:00100000:0.0:1789135895.699204:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:0.0:1789135895.699214:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+17:14713:x1876044512616064:12345-192.168.206.35@tcp:101:lfs.0 00010000:00010000:0.0:1789135895.699236:0:16819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135895.699266:0:16819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a51 expref: -99 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.699367:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5502 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.699382:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5502 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.699393:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5502 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135895.699404:0:16819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789135895.699526:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce54fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a51 expref: 20 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.699544:0:16819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5502 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a51 expref: 19 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.699569:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135895.699572:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135895.699576:0:16819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030600, rc 0) 00000100:00100000:0.0:1789135895.699644:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+19:14713:x1876044512616064:12345-192.168.206.35@tcp:101:lfs.0 Request processed in 431us (744us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789135895.699652:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 31 00000100:00100000:2.0:1789135895.711294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135895.711403:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512616192 00000100:00100000:1.0:1789135895.711412:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512616192 00000100:00100000:1.0:1789135895.711474:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:1.0:1789135895.711483:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+19:2377:x1876044512616192:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135895.711497:0:14727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135895.711518:0:14727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5502 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a51 expref: 19 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.711553:0:14727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:1.0:1789135895.711557:0:14727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135895.711610:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+18:2377:x1876044512616192:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.711617:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:1.0:1789135895.719889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135895.720046:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512616320 00000100:00100000:2.0:1789135895.720056:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512616320 00000100:00100000:2.0:1789135895.720137:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:2.0:1789135895.720146:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+18:14713:x1876044512616320:12345-192.168.206.35@tcp:54:lfs.0 00010000:00010000:2.0:1789135895.720212:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720229:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720239:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720276:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720298:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720304:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720310:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb3c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135895.720314:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720322:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720345:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135895.720348:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135895.720353:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.720359:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3c00/0x5b09da6ee1ce5510 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135895.720427:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+18:14713:x1876044512616320:12345-192.168.206.35@tcp:54:lfs.0 Request processed in 282us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.720435:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 32 00000100:00100000:2.0:1789135895.722895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135895.723092:0:14745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512616576 00000100:00100000:1.0:1789135895.723103:0:14745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512616576 00000100:00100000:1.0:1789135895.723156:0:14745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:1.0:1789135895.723166:0:14745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+18:14713:x1876044512616576:12345-192.168.206.35@tcp:35:lfs.0 00000100:00100000:1.0:1789135895.723415:0:14745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+19:14713:x1876044512616576:12345-192.168.206.35@tcp:35:lfs.0 Request processed in 250us (528us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789135895.723423:0:14745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00010000:00010000:1.0:1789135895.757037:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135896.069227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135896.069355:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512616832 00000100:00100000:0.0:1789135896.069365:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512616832 00000100:00100000:0.0:1789135896.069426:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:0.0:1789135896.069437:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+19:14744:x1876044512616832:12345-192.168.206.35@tcp:101:cat.0 00010000:00010000:0.0:1789135896.069460:0:16819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135896.069480:0:16819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5517 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a58 expref: -99 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.069572:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce551e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.069587:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce551e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.069598:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce551e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135896.069610:0:16819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789135896.069763:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5517 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a58 expref: 22 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.069802:0:16819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce551e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a58 expref: 21 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.069810:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135896.069813:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135896.069816:0:16819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031e00, rc 0) 00000100:00100000:0.0:1789135896.069884:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+21:14744:x1876044512616832:12345-192.168.206.35@tcp:101:cat.0 Request processed in 449us (666us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789135896.069892:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 33 00000100:00100000:3.0:1789135896.075971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000040:00080000:3.0:1789135896.076831:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789135896.077195:0:14745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512617088 00000100:00100000:1.0:1789135896.077204:0:14745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512617088 00000100:00100000:1.0:1789135896.077264:0:14745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:1.0:1789135896.077274:0:14745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+21:14744:x1876044512617088:12345-192.168.206.35@tcp:35:cat.0 00000100:00100000:1.0:1789135896.078268:0:14745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+22:14744:x1876044512617088:12345-192.168.206.35@tcp:35:cat.0 Request processed in 992us (2302us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789135896.078278:0:14745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 8 00000100:00100000:2.0:1789135896.078380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135896.079331:0:14729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512617216 00000100:00100000:1.0:1789135896.079351:0:14729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512617216 00000100:00100000:1.0:1789135896.079403:0:14729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:1.0:1789135896.079423:0:14729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+22:2375:x1876044512617216:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135896.079598:0:14729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135896.079625:0:14729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce551e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a58 expref: 22 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135896.079643:0:14729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:1.0:1789135896.079648:0:14729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135896.079694:0:14729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+21:2375:x1876044512617216:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 273us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135896.079701:0:14729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:2.0:1789135896.143852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135896.143953:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512617472 00000100:00100000:0.0:1789135896.143962:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512617472 00000100:00100000:0.0:1789135896.144021:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:0.0:1789135896.144031:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+21:14750:x1876044512617472:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:0.0:1789135896.144054:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135896.144137:0:14742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce552c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a5f expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.144228:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.144251:0:14742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 22 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.144261:0:14742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 22 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.144286:0:14742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.144319:0:14742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 22 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.144341:0:14742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 22 pid: 14742 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135896.144356:0:14742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14742:1876044545115136:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135896.144645:0:14742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 22 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.144656:0:14742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 22 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135896.144665:0:14742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346ead00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14742:1876044545115264:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135896.144689:0:14742:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc1345a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135896.147232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135896.147368:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135896.147443:0:14742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14742:1876044545115136:192.168.206.35@tcp:104: 00000100:00100000:0.0:1789135896.147454:0:14742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346ead00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14742:1876044545115264:192.168.206.35@tcp:104: 00010000:00010000:0.0:1789135896.147477:0:14742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135896.154509:0:14728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512617728 00000100:00100000:2.0:1789135896.154523:0:14728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512617728 00010000:00010000:2.0:1789135896.154574:0:14728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 23 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135896.154638:0:14728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512617600 00000100:00100000:2.0:1789135896.154643:0:14728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512617600 00010000:00010000:2.0:1789135896.154658:0:14728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 24 pid: 14742 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135896.154676:0:14728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:2.0:1789135896.154685:0:14728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc299c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:2376:x1876044512617728:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135896.154699:0:14728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135896.154705:0:14728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 24 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.154717:0:14728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 24 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.154738:0:14728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce54d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a3c expref: 24 pid: 16819 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.154756:0:14728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135896.154761:0:14728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.154770:0:14728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.154776:0:14728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135896.154825:0:14728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc299c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+23:2376:x1876044512617728:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 141us (7600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.154841:0:14728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:2.0:1789135896.154882:0:14728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 12 00000100:00100000:2.0:1789135896.154889:0:14728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+22:2375:x1876044512617600:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135896.154896:0:14728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135896.154901:0:14728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 22 pid: 14742 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.154912:0:14728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 22 pid: 14742 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.155417:0:14728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce54e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a43 expref: 22 pid: 14742 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.155431:0:14728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135896.155505:0:14728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.155513:0:14728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.155520:0:14728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.155543:0:14728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135896.155574:0:14728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+21:2375:x1876044512617600:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 685us (8205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.155581:0:14728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 12 00010000:00010000:0.0:1789135896.155696:0:14742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.155714:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135896.155733:0:14742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789135896.155896:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce552c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a5f expref: 22 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.155912:0:14742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031e00/0x5b09da6ee1ce5533 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a5f expref: 21 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.155927:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135896.155930:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135896.155932:0:14742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00031e00, rc 0) 00000100:00100000:0.0:1789135896.155971:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+21:14750:x1876044512617472:12345-192.168.206.35@tcp:101:dd.0 Request processed in 11942us (12130us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789135896.155978:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 34 00000100:00100000:0.0:1789135896.159043:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135896.159202:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512617984 00000100:00100000:2.0:1789135896.159212:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512617984 00000100:00100000:2.0:1789135896.159354:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 35 00000100:00100000:2.0:1789135896.159365:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+21:14750:x1876044512617984:12345-192.168.206.35@tcp:36:dd.0 00010000:00010000:2.0:1789135896.159600:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.159616:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.159626:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135896.159675:0:16819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789135896.159703:0:16819:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c60af045 reply state 00000000c8957282 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135896.159712:0:16819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135896.159901:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14750:x1876044512617984:12345-192.168.206.35@tcp:36:dd.0 Request processed in 537us (865us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789135896.159908:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 35 00000020:00080000:2.0:1789135896.159913:0:16819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789135896.164574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135896.164676:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512618112 00000100:00100000:0.0:1789135896.164685:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512618112 00000100:00100000:0.0:1789135896.164741:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 36 00000100:00100000:0.0:1789135896.164750:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14750:x1876044512618112:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:0.0:1789135896.164772:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135896.164793:0:14743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5548 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a66 expref: -99 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.164850:0:14743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5548 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a66 expref: 25 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.164884:0:14743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5548 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a66 expref: 25 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.164906:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135896.164909:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135896.164913:0:14743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030600, rc 0) 00000100:00100000:0.0:1789135896.164972:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+25:14750:x1876044512618112:12345-192.168.206.35@tcp:101:dd.0 Request processed in 223us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135896.164979:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 36 00010000:00010000:3.0:1789135896.165598:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135896.165608:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135896.165615:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135896.165621:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135896.165625:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135896.165633:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135896.165653:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:3.0:1789135896.165656:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135896.165659:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135896.165665:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2400/0x5b09da6ee1ce5541 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135896.173762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135896.173862:0:14728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512618368 00000100:00100000:2.0:1789135896.173871:0:14728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512618368 00000100:00100000:2.0:1789135896.174018:0:14728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:2.0:1789135896.174028:0:14728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14750:x1876044512618368:12345-192.168.206.35@tcp:103:dd.0 00010000:00010000:2.0:1789135896.174044:0:14728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135896.174098:0:14728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce5548 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a66 expref: 24 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135896.174136:0:14728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135896.174141:0:14728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135896.174186:0:14728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+23:14750:x1876044512618368:12345-192.168.206.35@tcp:103:dd.0 Request processed in 160us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135896.174194:0:14728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:0.0:1789135896.178158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135896.178282:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512618496 00000100:00100000:3.0:1789135896.178291:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512618496 00000100:00100000:3.0:1789135896.178355:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:3.0:1789135896.178365:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+23:14750:x1876044512618496:12345-192.168.206.35@tcp:58:dd.0 00010000:00010000:3.0:1789135896.178446:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135896.178461:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135896.178472:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135896.179838:0:16819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135896.179994:0:16819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789135896.180090:0:16819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789135896.180198:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+23:14750:x1876044512618496:12345-192.168.206.35@tcp:58:dd.0 Request processed in 1831us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135896.180210:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 37 00000100:00100000:0.0:1789135896.182454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135896.182532:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512618624 00000100:00100000:3.0:1789135896.182556:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512618624 00000100:00100000:3.0:1789135896.182618:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 38 00000100:00100000:3.0:1789135896.182627:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+23:14750:x1876044512618624:12345-192.168.206.35@tcp:101:dd.0 00010000:00010000:3.0:1789135896.182647:0:14743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135896.183573:0:14743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5556 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a6d expref: -99 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.183686:0:14743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.183699:0:14743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5556 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a6d expref: 24 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.183720:0:14743:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.183795:0:14743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5556 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a6d expref: 24 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.183810:0:14743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135896.183823:0:14743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135896.183828:0:14743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5556 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a6d expref: 24 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135896.183837:0:14743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31ec00, rc 0) 00000100:00100000:0.0:1789135896.184034:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14750:x1876044512618624:12345-192.168.206.35@tcp:101:dd.0 Request processed in 1406us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135896.184043:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 38 00010000:00010000:3.0:1789135896.780805:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135897.100325:0:14774:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789135897.100351:0:14774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135897.100401:0:14774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789135897.100418:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789135897.100540:0:14774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e9a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14774:1876044545115392:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789135897.100649:0:14774:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc13d819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.109109:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135897.109282:0:14774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e9a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14774:1876044545115392:192.168.206.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789135897.111108:0:14753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512618752 00000100:00100000:1.0:1789135897.111120:0:14753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512618752 00000100:00100000:1.0:1789135897.111191:0:14753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:1.0:1789135897.111203:0:14753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14751:x1876044512618752:12345-192.168.206.35@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789135897.111291:0:14753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14751:x1876044512618752:12345-192.168.206.35@tcp:900:lhsmtool_posix.0 Request processed in 91us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.111300:0:14753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00080000:3.0:1789135897.114488:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135897.120511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.121003:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512618880 00000100:00100000:0.0:1789135897.121014:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512618880 00000100:00100000:0.0:1789135897.121128:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:0.0:1789135897.121139:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14751:x1876044512618880:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135897.121169:0:14744:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135897.121295:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14751:x1876044512618880:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 158us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.121302:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 39 00000100:00100000:1.0:1789135897.125127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.126014:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512619008 00000100:00100000:0.0:1789135897.126025:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512619008 00000100:00100000:0.0:1789135897.126145:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:0.0:1789135897.126155:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14751:x1876044512619008:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789135897.126238:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126254:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126278:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126292:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126299:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126305:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126324:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126349:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126356:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135897.126392:0:14742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789135897.126397:0:14742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135897.126419:0:14742:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126430:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126444:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126450:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126456:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135897.126460:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126468:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126480:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc062d3400) 00010000:00010000:0.0:1789135897.126483:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135897.126487:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126493:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce555d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126508:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126515:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126520:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126525:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135897.126536:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126542:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126549:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8adc062d3100) 00010000:00010000:0.0:1789135897.126551:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135897.126554:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126559:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce5564 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126572:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126578:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126595:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126600:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135897.126602:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126608:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126614:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135897.126617:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135897.126626:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.126632:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce556b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.126709:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14751:x1876044512619008:12345-192.168.206.35@tcp:34:lhsmtool_posix.0 Request processed in 554us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.126718:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 40 00000100:00100000:2.0:1789135897.131732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135897.131961:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512619264 00000100:00100000:1.0:1789135897.132233:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512619264 00000100:00100000:1.0:1789135897.137380:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:1.0:1789135897.137404:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:14751:x1876044512619264:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135897.137427:0:14744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135897.137450:0:14744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce5572 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a74 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137561:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137577:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137589:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135897.137600:0:14744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789135897.137719:0:14744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137727:0:14744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137734:0:14744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137740:0:14744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc34bab200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789135897.137744:0:14744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137752:0:14744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137764:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:1.0:1789135897.137767:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789135897.137771:0:14744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137787:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce5579 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137833:0:14744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce5572 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a74 expref: 26 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137844:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8adc062d3400) 00010000:00010000:1.0:1789135897.137846:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135897.137850:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34baaa00/0x5b09da6ee1ce5572 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a74 expref: 26 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.137871:0:14744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34baaa00, rc 0) 00000100:00100000:1.0:1789135897.137937:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+25:14751:x1876044512619264:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 544us (6214us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789135897.137946:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 41 00000100:00100000:3.0:1789135897.141425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.141579:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512619392 00000100:00100000:2.0:1789135897.141589:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512619392 00000100:00100000:2.0:1789135897.141732:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:2.0:1789135897.141743:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+25:14751:x1876044512619392:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789135897.141778:0:14743:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789135897.142191:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+25:14751:x1876044512619392:12345-192.168.206.35@tcp:53:lhsmtool_posix.0 Request processed in 448us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.142200:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 42 00000100:00100000:1.0:1789135897.155586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.157267:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512619648 00000100:00100000:0.0:1789135897.157281:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512619648 00000100:00100000:0.0:1789135897.157361:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:0.0:1789135897.157381:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+25:14751:x1876044512619648:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135897.157403:0:14744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135897.157423:0:14744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5587 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a7b expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135897.158023:0:14744:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1789135897.158030:0:14744:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789135897.160726:0:14744:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789135897.162349:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2e00/0x5b09da6ee1ce558e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.162378:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2e00/0x5b09da6ee1ce558e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.162391:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2e00/0x5b09da6ee1ce558e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.162456:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00031400/0x5b09da6ee1ce5587 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a7b expref: 28 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.162493:0:14744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2e00/0x5b09da6ee1ce558e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a7b expref: 27 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.162502:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:2.0:1789135897.162504:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135897.162507:0:14744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb2e00, rc 0) 00000100:00100000:2.0:1789135897.162585:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+27:14751:x1876044512619648:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 5215us (7008us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789135897.162595:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 43 00000100:00100000:3.0:1789135897.167317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.167401:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512619904 00000100:00100000:0.0:1789135897.167411:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512619904 00000100:00100000:0.0:1789135897.167468:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:0.0:1789135897.167478:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+27:14751:x1876044512619904:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789135897.167531:0:14742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135897.167557:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2e00/0x5b09da6ee1ce558e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a7b expref: 27 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167574:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a400) 00010000:00010000:0.0:1789135897.167597:0:14742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135897.167619:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167631:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167642:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167656:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167663:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167669:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167736:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167743:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167749:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167754:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135897.167758:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167764:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167780:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8adc062d3800) 00010000:00010000:0.0:1789135897.167783:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135897.167787:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167794:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce559c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167804:0:14742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167811:0:14742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167816:0:14742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167822:0:14742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135897.167825:0:14742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167831:0:14742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167838:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x37ba8e5f (ffff8adc062d3100) 00010000:00010000:0.0:1789135897.167840:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135897.167843:0:14742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.167848:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030600/0x5b09da6ee1ce55a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x37ba8e5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.167941:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+26:14751:x1876044512619904:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 464us (632us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135897.167948:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 44 00000100:00100000:3.0:1789135897.186169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.186439:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512620032 00000100:00100000:2.0:1789135897.186449:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512620032 00000100:00100000:2.0:1789135897.186509:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:2.0:1789135897.186518:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc345d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+26:14751:x1876044512620032:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135897.186539:0:16819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135897.186561:0:16819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55aa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a82 expref: -99 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.186597:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3200/0x5b09da6ee1ce55b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.186610:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3200/0x5b09da6ee1ce55b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.186622:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3200/0x5b09da6ee1ce55b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.186723:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a82 expref: 28 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.187127:0:16819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3200/0x5b09da6ee1ce55b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a82 expref: 27 pid: 16819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.187137:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:2.0:1789135897.187140:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135897.187143:0:16819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3200, rc 0) 00000100:00100000:2.0:1789135897.187195:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc345d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+27:14751:x1876044512620032:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 679us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.187203:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 45 00000100:00100000:1.0:1789135897.198648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.202227:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512620288 00000100:00100000:0.0:1789135897.202242:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512620288 00000100:00100000:0.0:1789135897.202395:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:0.0:1789135897.202407:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+27:14751:x1876044512620288:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789135897.202489:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.202507:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.202518:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789135897.203361:0:14742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789135897.203374:0:14742:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 520775310591ns, next at 521775307991ns, rc = 0 00000004:00010000:0.0:1789135897.203468:0:14742:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000028e8ff70 reply state 000000005719f372 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.203478:0:14742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135897.203823:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+29:14751:x1876044512620288:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 1177us (5002us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789135897.203832:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 46 00000100:00100000:3.0:1789135897.206577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:0.0:1789135897.211012:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.211053:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.211106:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.211190:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135897.211195:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.211534:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.211555:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:0.0:1789135897.211558:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135897.211563:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.211571:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135897.211894:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512620416 00000100:00100000:1.0:1789135897.212089:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512620416 00000100:00100000:1.0:1789135897.213651:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:1.0:1789135897.213673:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+28:14751:x1876044512620416:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135897.213697:0:14744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135897.213718:0:14744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a89 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.213784:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 29 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.213811:0:14744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 29 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.213830:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:1.0:1789135897.213833:0:14744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135897.213837:0:14744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc34bab200, rc 0) 00000100:00100000:1.0:1789135897.213934:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+29:14751:x1876044512620416:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 271us (7364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.213942:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 47 00000100:00100000:1.0:1789135897.224185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.229406:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512620544 00000100:00100000:2.0:1789135897.229420:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512620544 00000100:00100000:2.0:1789135897.229519:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1789135897.229532:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2375:x1876044512620544:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789135897.230824:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135897.231461:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2375:x1876044512620544:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 464us (5818us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789135897.231478:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:0.0:1789135897.236341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.236447:0:14746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512620800 00000100:00100000:2.0:1789135897.236458:0:14746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512620800 00000100:00100000:2.0:1789135897.236520:0:14746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:2.0:1789135897.236531:0:14746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+29:14751:x1876044512620800:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789135897.237263:0:14746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+30:14751:x1876044512620800:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 729us (936us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789135897.237272:0:14746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 9 00000100:00100000:1.0:1789135897.249794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.254157:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512621056 00000100:00100000:2.0:1789135897.254188:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512621056 00000100:00100000:2.0:1789135897.254307:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:2.0:1789135897.254318:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+30:14751:x1876044512621056:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135897.254457:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+30:14751:x1876044512621056:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 140us (4672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.254465:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 48 00000100:00100000:1.0:1789135897.258115:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.262671:0:14742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512621184 00000100:00100000:0.0:1789135897.262684:0:14742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512621184 00000100:00100000:0.0:1789135897.262750:0:14742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:0.0:1789135897.262759:0:14742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+30:14751:x1876044512621184:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135897.262776:0:14742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135897.262795:0:14742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a90 expref: -99 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.263040:0:14742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce55cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.263054:0:14742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce55cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.263111:0:14742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce55cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135897.263145:0:14742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789135897.263160:0:14742:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce55cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.263183:0:14742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030400/0x5b09da6ee1ce55c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a90 expref: 32 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.263200:0:14742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce55cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a90 expref: 31 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.263208:0:14742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:0.0:1789135897.263211:0:14742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789135897.263214:0:14742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc00030800, rc 0) 00000100:00100000:0.0:1789135897.263304:0:14742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+31:14751:x1876044512621184:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 546us (5198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.263311:0:14742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 49 00000100:00100000:1.0:1789135897.267241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135897.267290:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512621312 00000100:00100000:3.0:1789135897.267300:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512621312 00000100:00100000:3.0:1789135897.267399:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:3.0:1789135897.267410:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+6:2375:x1876044512621312:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135897.267425:0:15426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135897.267444:0:15426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a97 expref: -99 pid: 15426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135897.267468:0:15426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c19, blocks: 0x1 00010000:00010000:3.0:1789135897.267486:0:15426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1789135897.267490:0:15426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.267498:0:15426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 7 pid: 15426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.267515:0:15426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 7 pid: 15426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.267540:0:15426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc3a31e600, rc 0) 00000100:00100000:3.0:1789135897.267604:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2375:x1876044512621312:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 195us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.267611:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:1.0:1789135897.270175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.270235:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512621568 00000100:00100000:2.0:1789135897.270243:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512621568 00000100:00100000:2.0:1789135897.270284:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:2.0:1789135897.270292:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+31:14751:x1876044512621568:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135897.270389:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+31:14751:x1876044512621568:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.270396:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 50 00000100:00100000:1.0:1789135897.272479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.272546:0:14743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512621696 00000100:00100000:2.0:1789135897.272554:0:14743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512621696 00000100:00100000:2.0:1789135897.272615:0:14743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:2.0:1789135897.272624:0:14743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+31:14751:x1876044512621696:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789135897.324097:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1789135897.324111:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789135897.324149:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1789135897.324170:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:0.0:1789135897.324257:0:14743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+14:14751:x1876044512621696:12345-192.168.206.35@tcp:44:lhsmtool_posix.0 Request processed in 51628us (51779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.324269:0:14743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 51 00000100:00100000:1.0:1789135897.324519:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135897.324535:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545115520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789135897.324589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135897.324701:0:15425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545115520 00000100:00100000:2.0:1789135897.324709:0:15425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545115520 00000100:00100000:2.0:1789135897.324762:0:15425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135897.324771:0:15425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545115520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789135897.325239:0:15425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789135897.325243:0:15425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789135897.325245:0:15425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789135897.325247:0:15425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789135897 -> 1789135897 00002000:00010000:2.0:1789135897.325249:0:15425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789135897.325299:0:15425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876044545115520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 528us (715us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789135897.325307:0:15425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1789135897.325358:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc3a2f5e00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789135897.325365:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545115520:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789135897.325495:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135897.330013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.330136:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512621824 00000100:00100000:0.0:1789135897.330144:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512621824 00000100:00100000:0.0:1789135897.330191:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:0.0:1789135897.330199:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2376:x1876044512621824:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789135897.330300:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2376:x1876044512621824:12345-192.168.206.35@tcp:16:lhsmtool_posix.0 Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.330308:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1789135897.336168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.336264:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512622080 00000100:00100000:2.0:1789135897.336273:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512622080 00000100:00100000:2.0:1789135897.336340:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:2.0:1789135897.336350:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+14:14751:x1876044512622080:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789135897.336399:0:14744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135897.336423:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc00030800/0x5b09da6ee1ce55cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a90 expref: 14 pid: 14742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.336444:0:14744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:2.0:1789135897.336450:0:14744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135897.336477:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.336490:0:14744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.336499:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135897.336669:0:14744:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000beb580e8 reply state 000000001c5e3eb4 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.336678:0:14744:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135897.336817:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+15:14751:x1876044512622080:12345-192.168.206.35@tcp:36:lhsmtool_posix.0 Request processed in 468us (658us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789135897.336836:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 52 00000100:00100000:0.0:1789135897.343405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00010000:00010000:3.0:1789135897.343527:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.343540:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.343548:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.343554:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789135897.343559:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.343567:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.343582:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:3.0:1789135897.343586:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135897.343591:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.343598:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2a00/0x5b09da6ee1ce55db lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.343988:0:15425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512622208 00000100:00100000:2.0:1789135897.343997:0:15425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512622208 00000100:00100000:2.0:1789135897.344050:0:15425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1789135897.344059:0:15425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:14751:x1876044512622208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135897.344201:0:15425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135897.344223:0:15425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc4f3749c1b1d3a9e expref: -99 pid: 15425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.344251:0:15425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 8 pid: 15426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.344260:0:15425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135897.344264:0:15425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135897.344270:0:15425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 8 pid: 15425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.344302:0:15425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 8 pid: 15426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.344315:0:15425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 8 pid: 15426 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.344341:0:15425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15425:1876044545115648:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135897.344542:0:15425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05527240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135897.357630:0:15425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3a2f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15425:1876044545115648:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135897.357664:0:15425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 8 pid: 15425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.357683:0:15425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc13fb3a00, rc 0) 00000100:00100000:2.0:1789135897.357740:0:15425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+8:14751:x1876044512622208:12345-192.168.206.35@tcp:101:lhsmtool_posix.0 Request processed in 13682us (14344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.357749:0:15425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1789135897.358800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.358947:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512622336 00000100:00100000:0.0:1789135897.358955:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512622336 00010000:00010000:0.0:1789135897.358992:0:14727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 8 pid: 15426 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.359033:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:0.0:1789135897.359041:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3a2f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+8:2376:x1876044512622336:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135897.359054:0:14727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135897.359106:0:14727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 8 pid: 15426 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.359119:0:14727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 8 pid: 15426 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.359139:0:14727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce55d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a97 expref: 8 pid: 15426 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.359153:0:14727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.359170:0:14727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.359176:0:14727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 7 pid: 15425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.359185:0:14727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 7 pid: 15425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.359219:0:14727:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 7 pid: 15425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.359233:0:14727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e83c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14727:1876044545115776:192.168.206.35@tcp:105: 00000100:00100000:0.0:1789135897.359294:0:14727:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc033c7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135897.364538:0:14727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e83c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14727:1876044545115776:192.168.206.35@tcp:105: 00010000:00010000:2.0:1789135897.364566:0:14727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135897.364616:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3a2f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2376:x1876044512622336:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 5574us (5818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.364627:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 13 00000100:00100000:1.0:1789135897.365171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.365255:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512622464 00000100:00100000:0.0:1789135897.365263:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512622464 00000100:00100000:0.0:1789135897.365312:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:0.0:1789135897.365321:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2375:x1876044512622464:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789135897.365514:0:16217:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789135897.365518:0:16217:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789135896 00002000:00010000:0.0:1789135897.365521:0:16217:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789135895 00002000:00010000:0.0:1789135897.365523:0:16217:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789135897 -> 1789135896 00002000:00010000:0.0:1789135897.365525:0:16217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789135897.365559:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+8:2375:x1876044512622464:12345-192.168.206.35@tcp:2:lhsmtool_posix.0 Request processed in 239us (389us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789135897.365567:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:1.0:1789135897.368548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.368644:0:15424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512622592 00000100:00100000:2.0:1789135897.368652:0:15424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512622592 00000100:00100000:2.0:1789135897.368701:0:15424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:2.0:1789135897.368709:0:15424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+8:2375:x1876044512622592:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789135897.368747:0:15424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.368766:0:15424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 8 pid: 15425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.368775:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135897.368784:0:15424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135897.368790:0:15424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.368821:0:15424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 8 pid: 15425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.368834:0:15424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 8 pid: 15425 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.368848:0:15424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3adb3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15424:1876044545115904:192.168.206.35@tcp:104: 00000100:00100000:2.0:1789135897.368933:0:15424:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc05527240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135897.370674:0:15424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3adb3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15424:1876044545115904:192.168.206.35@tcp:104: 00010000:00010000:2.0:1789135897.370697:0:15424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135897.372213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.372296:0:14728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512622720 00000100:00100000:2.0:1789135897.372304:0:14728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512622720 00010000:00010000:2.0:1789135897.372351:0:14728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 9 pid: 15425 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.372391:0:14728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 14 00000100:00100000:2.0:1789135897.372400:0:14728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+9:2375:x1876044512622720:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135897.372414:0:14728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135897.372435:0:14728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 9 pid: 15425 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.372462:0:14728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 9 pid: 15425 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.372486:0:14728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b520eb20/0x5b09da6ee1ce55e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a9e expref: 9 pid: 15425 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.372501:0:14728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135897.372505:0:14728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135897.372511:0:14728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.372519:0:14728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.372551:0:14728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135897.372604:0:14728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+8:2375:x1876044512622720:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 205us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.372612:0:14728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 14 00010000:00010000:1.0:1789135897.372773:0:15424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.372783:0:15424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.372805:0:15424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.372813:0:15424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.372820:0:15424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.372826:0:15424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:1.0:1789135897.372830:0:15424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.372838:0:15424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.372849:0:15424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.372856:0:15424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa4ec628/0x5b09da6ee1ce55e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135897.372927:0:15424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2375:x1876044512622592:12345-192.168.206.35@tcp:1:lhsmtool_posix.0 Request processed in 4218us (4387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.372935:0:15424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 16 00000100:00100000:1.0:1789135897.380286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135897.380389:0:16819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512622976 00000100:00100000:3.0:1789135897.380398:0:16819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512622976 00000100:00100000:3.0:1789135897.380456:0:16819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 53 00000100:00100000:3.0:1789135897.380465:0:16819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+14:14751:x1876044512622976:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789135897.380539:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.380556:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.380566:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.380779:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.380790:0:16819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 15 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.380799:0:16819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.380828:0:16819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 15 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.380841:0:16819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 15 pid: 14744 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135897.380855:0:16819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16819:1876044545116032:192.168.206.35@tcp:104: 00000100:00100000:3.0:1789135897.380943:0:16819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc3ad6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.387947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.388042:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512623104 00000100:00100000:2.0:1789135897.388052:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512623104 00010000:00010000:2.0:1789135897.388109:0:14727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 16 pid: 14744 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.388153:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 15 00000100:00100000:2.0:1789135897.388163:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+16:2375:x1876044512623104:12345-192.168.206.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135897.388192:0:14727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135897.388199:0:14727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 16 pid: 14744 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.388212:0:14727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 16 pid: 14744 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.388235:0:14727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:2.0:1789135897.388241:0:14727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.388251:0:14727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.388259:0:14727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.388277:0:14727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135897.388346:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+16:2375:x1876044512623104:12345-192.168.206.35@tcp:103:ldlm_bl.0 Request processed in 183us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.388354:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 15 00010000:00010000:3.0:1789135897.391395:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc34bab200/0x5b09da6ee1ce55bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a89 expref: 15 pid: 14744 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135897.391420:0:16819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc41cef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16819:1876044545116032:192.168.206.35@tcp:104: 00010000:00010000:3.0:1789135897.391445:0:16819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.391564:0:16819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.391644:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135897.391810:0:16819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789135897.392778:0:16819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789135897.392840:0:16819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789135897.393485:0:16819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16819:1876044545116160:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135897.393577:0:16819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135897.393891:0:16819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc033c7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135897.394007:0:14747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545116160 00000100:00100000:2.0:1789135897.394015:0:14747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545116160 00000100:00100000:2.0:1789135897.394089:0:14747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135897.394169:0:14747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16819:x1876044545116160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789135897.394256:0:14747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16819:x1876044545116160:12345-0@lo:1000:mdt00_003.0 Request processed in 159us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.394265:0:14747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135897.394301:0:16819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16819:1876044545116160:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789135897.395115:0:16819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789135897.395195:0:16819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16819:1876044545116288:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135897.395249:0:16819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135897.395271:0:16819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc033c7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135897.395294:0:14748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545116288 00000100:00100000:1.0:1789135897.395300:0:14748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545116288 00000100:00100000:1.0:1789135897.395339:0:14748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135897.395351:0:14748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16819:x1876044545116288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789135897.395502:0:14748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16819:x1876044545116288:12345-0@lo:1000:mdt00_003.0 Request processed in 155us (252us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789135897.395509:0:14748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135897.395545:0:16819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16819:1876044545116288:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789135897.395580:0:16819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395660:0:16819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395667:0:16819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395673:0:16819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fe00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135897.395677:0:16819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395696:0:16819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395711:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:0.0:1789135897.395714:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135897.395720:0:16819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395726:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fe00/0x5b09da6ee1ce55f7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395754:0:16819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395760:0:16819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395766:0:16819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395771:0:16819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fa00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789135897.395773:0:16819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395779:0:16819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395785:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:0.0:1789135897.395787:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135897.395794:0:16819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5556 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a6d expref: 18 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395816:0:16819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5556 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a6d expref: 18 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395825:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5556 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a6d expref: 18 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.395874:0:16819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31ec00/0x5b09da6ee1ce5556 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.35@tcp remote: 0xc4f3749c1b1d3a6d expref: 18 pid: 14743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.395885:0:16819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc346e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16819:1876044545116416:192.168.206.35@tcp:105: 00000100:00100000:0.0:1789135897.396244:0:16819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8adc033c76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.398888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135897.398977:0:14746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512623232 00000100:00100000:3.0:1789135897.398986:0:14746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512623232 00000100:00100000:3.0:1789135897.399041:0:14746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:3.0:1789135897.399051:0:14746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc07710050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+19:14750:x1876044512623232:12345-192.168.206.35@tcp:49:dd.0 00000100:00100000:3.0:1789135897.399202:0:14746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc07710050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+19:14750:x1876044512623232:12345-192.168.206.35@tcp:49:dd.0 Request processed in 152us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.399209:0:14746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 10 00000100:00100000:2.0:1789135897.401079:0:16819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc346e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16819:1876044545116416:192.168.206.35@tcp:105: 00010000:00010000:2.0:1789135897.401177:0:16819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401187:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31fa00/0x5b09da6ee1ce554f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401221:0:16819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401232:0:16819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401242:0:16819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401251:0:16819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401256:0:16819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401262:0:16819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401267:0:16819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb3a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135897.401270:0:16819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401275:0:16819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401295:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135897.401309:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135897.401313:0:16819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401319:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb3a00/0x5b09da6ee1ce55fe lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401340:0:16819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401346:0:16819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401352:0:16819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401356:0:16819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789135897.401358:0:16819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401362:0:16819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401369:0:16819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc062d3c00) 00010000:00010000:2.0:1789135897.401371:0:16819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135897.401374:0:16819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.401379:0:16819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc3a31e600/0x5b09da6ee1ce55f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.401578:0:16819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+18:14751:x1876044512622976:12345-192.168.206.35@tcp:57:lhsmtool_posix.0 Request processed in 21112us (21299us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789135897.401596:0:16819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 53 00000020:00080000:2.0:1789135897.401601:0:16819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789135897.401721:0:14774:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789135897.401726:0:14774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135897.401769:0:14774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789135897.401774:0:14774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789135897.403882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135897.404028:0:14746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512623488 00000100:00100000:3.0:1789135897.404037:0:14746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512623488 00000100:00100000:3.0:1789135897.404116:0:14746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 11 00000100:00100000:3.0:1789135897.404125:0:14746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+18:14751:x1876044512623488:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789135897.404869:0:14746:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789135897.406389:0:14746:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789135897.406545:0:14746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.406563:0:14746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.406574:0:14746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.406582:0:14746:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.406588:0:14746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.406594:0:14746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.406656:0:14746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789135897.406782:0:14746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+20:14751:x1876044512623488:12345-192.168.206.35@tcp:35:lhsmtool_posix.0 Request processed in 2655us (2902us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789135897.406791:0:14746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 11 00000020:00080000:2.0:1789135897.406797:0:14746:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789135897.407569:0:14731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135897.407577:0:14731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.407651:0:14731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc13fb2600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135897.407655:0:14731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.407663:0:14731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.407677:0:14731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8adc1171a100) 00010000:00010000:3.0:1789135897.407679:0:14731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789135897.407684:0:14731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.407690:0:14731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc13fb2600/0x5b09da6ee1ce5605 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.408191:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135897.408194:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135897.408197:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135897.608020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.608196:0:15429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512623616 00000100:00100000:0.0:1789135897.608206:0:15429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512623616 00000100:00100000:0.0:1789135897.608269:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:0.0:1789135897.608279:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+7:2378:x1876044512623616:12345-192.168.206.35@tcp:4:dd.0 00002000:00010000:0.0:1789135897.608337:0:15429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa40c18, atime: 0x6aa40c17, ctime: 0x6aa40c18, blocks: 0x1 00010000:00010000:0.0:1789135897.608347:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.608372:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=521s v=(0 0) 00010000:00010000:0.0:1789135897.608377:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.608387:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.608421:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.617640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.617675:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.617705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135897.618138:0:15430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789135897.618148:0:15430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789135897.618681:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512623744 00000100:00100000:3.0:1789135897.618690:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512623744 00000100:00100000:3.0:1789135897.618735:0:15430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789135897.618743:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512623872 00000100:00100000:3.0:1789135897.618746:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512623872 00000100:00100000:3.0:1789135897.618759:0:15430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789135897.618763:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512624000 00000100:00100000:3.0:1789135897.618766:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512624000 00000100:00100000:0.0:1789135897.620716:0:16972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:0.0:1789135897.620733:0:16972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+10:2378:x1876044512623744:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:0.0:1789135897.620771:0:16972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.620788:0:16972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.620793:0:16972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.620800:0:16972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.620813:0:16972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135897.622529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:3.0:1789135897.624422:0:15430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789135897.624437:0:15430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789135897.628990:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512624128 00000100:00100000:2.0:1789135897.629003:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512624128 00000100:00100000:1.0:1789135897.629446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:1.0:1789135897.629473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135897.629530:0:15430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789135897.629542:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512624256 00000100:00100000:2.0:1789135897.629546:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512624256 00000100:00100000:2.0:1789135897.629579:0:15430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789135897.629585:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512624384 00000100:00100000:2.0:1789135897.629588:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512624384 00000100:00100000:1.0:1789135897.639411:0:15431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789135897.654672:0:16973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:3.0:1789135897.654690:0:16973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+15:2378:x1876044512623872:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:3.0:1789135897.654732:0:16973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.654760:0:16973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.654765:0:16973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.654772:0:16973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.654787:0:16973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.659229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135897.659318:0:15430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1789135897.659400:0:15430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1789135897.659965:0:15430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512624512 00000100:00100000:0.0:1789135897.659981:0:15430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512624512 00000100:00100000:3.0:1789135897.662926:0:16974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1789135897.662942:0:16974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+17:2378:x1876044512624000:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:3.0:1789135897.662998:0:16974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.663016:0:16974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.663020:0:16974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.663027:0:16974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.663042:0:16974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135897.785636:0:16972:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1789135897.785645:0:16972:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789135896 -> 1789135897 00002000:00010000:0.0:1789135897.785648:0:16972:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789135896 -> 1789135897 00002000:00010000:0.0:1789135897.785662:0:16972:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:0.0:1789135897.785677:0:16972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.785690:0:16972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.785699:0:16972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.785706:0:16972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030800 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135897.785710:0:16972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.785719:0:16972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.785739:0:16972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.785747:0:16972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000391f7e5/0x5b09da6ee1ce5613 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.785836:0:16972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+25:2378:x1876044512623744:12345-192.168.206.35@tcp:4:dd.0 Request processed in 165105us (168201us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789135897.785846:0:16972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 1 00000100:00100000:0.0:1789135897.785876:0:16972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 4 00000100:00100000:0.0:1789135897.785894:0:16972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:2378:x1876044512624128:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:0.0:1789135897.785934:0:16972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.785945:0:16972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.785950:0:16972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.785955:0:16972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.785975:0:16972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788551:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788570:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788635:0:15429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788644:0:15429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135897.788649:0:15429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788658:0:15429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788699:0:15429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788707:0:15429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9776ad3/0x5b09da6ee1ce560c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.788783:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+24:2378:x1876044512623616:12345-192.168.206.35@tcp:4:dd.0 Request processed in 180501us (180877us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789135897.788792:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 0 00000100:00100000:0.0:1789135897.788824:0:15429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 5 00000100:00100000:0.0:1789135897.788834:0:15429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+23:2377:x1876044512624256:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:0.0:1789135897.788861:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788872:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.788876:0:15429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135897.788882:0:15429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.788904:0:15429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135897.789056:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1789135897.789090:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1789135897.792339:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1789135897.792361:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00010000:00010000:2.0:1789135897.804267:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789135897.842201:0:16974:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:3.0:1789135897.842221:0:16974:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789135897.842236:0:16974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.842249:0:16974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.842258:0:16974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.842268:0:16974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31fa00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135897.842274:0:16974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.842283:0:16974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.842553:0:16974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.842562:0:16974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbe9f76c/0x5b09da6ee1ce5621 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135897.842733:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000100:00100000:3.0:1789135897.842815:0:16974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+17:2378:x1876044512624000:12345-192.168.206.35@tcp:4:dd.0 Request processed in 179873us (225104us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789135897.842825:0:16974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 3 00000100:00100000:3.0:1789135897.842863:0:16974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 6 00000100:00100000:3.0:1789135897.842875:0:16974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+16:2377:x1876044512624384:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:3.0:1789135897.843588:0:16974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843603:0:16974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.843608:0:16974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.843614:0:16974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843627:0:16974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843718:0:16973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843728:0:16973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843736:0:16973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843744:0:16973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc3a31e600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135897.843748:0:16973:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843756:0:16973:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843781:0:16973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.843788:0:16973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b0f67a/0x5b09da6ee1ce561a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135897.843851:0:16973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+15:2378:x1876044512623872:12345-192.168.206.35@tcp:4:dd.0 Request processed in 189166us (226173us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789135897.843860:0:16973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 2 00000100:00100000:3.0:1789135897.844575:0:16973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 7 00000100:00100000:3.0:1789135897.844591:0:16973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+14:2377:x1876044512624512:12345-192.168.206.35@tcp:4:dd.0 00010000:00010000:3.0:1789135897.844615:0:16973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.844626:0:16973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.844630:0:16973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135897.844634:0:16973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.844645:0:16973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135897.910259:0:16972:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1789135897.910269:0:16972:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1789135897.910283:0:16972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.910318:0:16972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.910337:0:16972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.910344:0:16972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00031400 already unused, calling callback (ffffffffc1431550) 00010000:00010000:0.0:1789135897.910348:0:16972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.910358:0:16972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.910379:0:16972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.910386:0:16972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca73f868/0x5b09da6ee1ce5628 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.910425:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.910453:0:15429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.910462:0:15429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.910469:0:15429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc00030600 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135897.910473:0:15429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.910479:0:16972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+19:2378:x1876044512624128:12345-192.168.206.35@tcp:4:dd.0 Request processed in 124583us (287952us total) trans 8589934603 rc 0/0 00010000:00010000:3.0:1789135897.910488:0:15429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.910495:0:16972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 4 00010000:00010000:3.0:1789135897.910509:0:15429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.910518:0:15429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075465e08/0x5b09da6ee1ce562f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135897.910559:0:15429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+17:2377:x1876044512624256:12345-192.168.206.35@tcp:4:dd.0 Request processed in 121726us (281117us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789135897.910566:0:15429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 5 00000001:00080000:3.0:1789135897.910595:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1789135897.980482:0:16973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1789135897.980505:0:16973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.980529:0:16973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.980537:0:16973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.980545:0:16973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045000 already unused, calling callback (ffffffffc1431550) 00010000:00010000:3.0:1789135897.980549:0:16973:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.980559:0:16973:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.980579:0:16973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.980587:0:16973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a9a5190/0x5b09da6ee1ce563d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135897.980684:0:16973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+11:2377:x1876044512624512:12345-192.168.206.35@tcp:4:dd.0 Request processed in 136095us (321460us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789135897.980695:0:16973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 7 00000001:00080000:3.0:1789135897.980738:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:2.0:1789135897.981156:0:16974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.981166:0:16974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.981173:0:16974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.981179:0:16974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc42045c00 already unused, calling callback (ffffffffc1431550) 00010000:00010000:2.0:1789135897.981183:0:16974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.981190:0:16974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.981202:0:16974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.981209:0:16974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bcbbcbb/0x5b09da6ee1ce5636 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.981277:0:16974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+8:2377:x1876044512624384:12345-192.168.206.35@tcp:4:dd.0 Request processed in 138405us (351802us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789135897.981404:0:16974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 6 00010000:00010000:3.0:1789135898.828809:0:16221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135899.577333:0:17014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789135899.852285:0:14731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135900.595442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135900.595474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135900.595583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135900.595610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135900.598842:0:14736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512624640 00000100:00100000:2.0:1789135900.598854:0:14736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512624640 00000100:00100000:2.0:1789135900.598911:0:14736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:2.0:1789135900.598921:0:14736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+13:2378:x1876044512624640:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135900.598994:0:14736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1abbebdb-1042-461e-9415-0f20361f1e33+13:2378:x1876044512624640:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 74us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135900.599002:0:14736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 122 00000100:00100000:3.0:1789135900.602082:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512624896 00000100:00100000:3.0:1789135900.602110:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512624896 00000100:00100000:0.0:1789135900.602299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135900.602337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:0.0:1789135900.602536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.35@tcp (source: 12345-192.168.206.35@tcp) 00000100:00100000:2.0:1789135900.602562:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512625408 00000100:00100000:2.0:1789135900.602567:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512625408 00000100:00100000:2.0:1789135900.602586:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512625024 00000100:00100000:2.0:1789135900.602589:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512625024 00000100:00100000:2.0:1789135900.602604:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:2.0:1789135900.602612:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512624896:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135900.602681:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512624896:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 70us (7206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135900.602688:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 17 00000100:00100000:2.0:1789135900.602703:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:2.0:1789135900.602709:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2378:x1876044512625408:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135900.602732:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2378:x1876044512625408:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 24us (7122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135900.602748:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 18 00000100:00100000:2.0:1789135900.602761:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00100000:2.0:1789135900.602767:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512625024:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135900.602791:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+5:2378:x1876044512625024:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135900.602797:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 19 00000100:00080000:2.0:1789135900.602937:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135900.602941:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135900.603528:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512625152 00000100:00100000:2.0:1789135900.603532:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512625280 00000100:00100000:0.0:1789135900.603536:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512625152 00000100:00100000:2.0:1789135900.603539:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512625280 00000100:00100000:0.0:1789135900.603586:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044512624768 00000100:00100000:0.0:1789135900.603590:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044512624768 00000100:00100000:2.0:1789135900.603596:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:2.0:1789135900.603608:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2378:x1876044512625280:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135900.603618:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:0.0:1789135900.603628:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc346e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:2378:x1876044512625152:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:2.0:1789135900.603655:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+5:2378:x1876044512625280:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 49us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135900.603663:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 20 00000100:00100000:0.0:1789135900.603669:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc346e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d5f32110-f3f1-4e5b-8f9c-f7456d1675da+6:2378:x1876044512625152:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 41us (8084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135900.603677:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 26 00000100:00100000:0.0:1789135900.603696:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00100000:0.0:1789135900.603703:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+20:2378:x1876044512624768:12345-192.168.206.35@tcp:400:kworker.0 00000100:00100000:0.0:1789135900.603730:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a4aa2af-23cd-4fad-a73b-6e2cefc37572+20:2378:x1876044512624768:12345-192.168.206.35@tcp:400:kworker.0 Request processed in 29us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135900.603736:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.35@tcp, seq: 27 00000100:00080000:3.0:1789135900.603895:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135900.603900:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135900.684274:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3adb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545116544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135900.684356:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135900.684430:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545116544 00000100:00100000:0.0:1789135900.684437:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545116544 00000100:00100000:0.0:1789135900.684494:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135900.684503:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545116544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135900.684536:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789135900.684589:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876044545116544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135900.684596:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789135900.684623:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135900.684646:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789135900.684650:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc3a2f5e00, transno 8589934595 00000004:00080000:0.0:1789135900.684660:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1789135900.684682:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3adb1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876044545116544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135900.686134:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3adb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545116800:0@lo:400:kworker.0 00000100:00100000:2.0:1789135900.686189:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135900.686223:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3adb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545117312:0@lo:400:kworker.0 00000100:00100000:2.0:1789135900.686248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135900.686267:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135900.686272:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3adb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545116928:0@lo:400:kworker.0 00000100:00100000:2.0:1789135900.686319:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135900.686346:0:15426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545116928 00000100:00100000:2.0:1789135900.686351:0:15426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545116928 00000100:00100000:2.0:1789135900.686398:0:15426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789135900.686406:0:15426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545116928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135900.686452:0:15426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876044545116928:12345-0@lo:400:kworker.0 Request processed in 47us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135900.686459:0:15426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789135900.686497:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3adb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876044545116928:0@lo:400:kworker.0 00000100:00100000:1.0:1789135900.686578:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3adb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545116672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135900.686613:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135900.686639:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3adb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545117184:0@lo:400:kworker.0 00000100:00100000:1.0:1789135900.686658:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135900.686673:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135900.686678:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8adc3adb03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545117056:0@lo:400:kworker.0 00000100:00100000:1.0:1789135900.686696:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135900.688760:0:15427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545116672 00000100:00100000:2.0:1789135900.688773:0:15427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545116672 00000100:00100000:2.0:1789135900.688835:0:15427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135900.688845:0:15427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545116672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135900.688883:0:15427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789135900.688979:0:15427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876044545116672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135900.688986:0:15427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135900.689041:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3adb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876044545116672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135900.689572:0:14737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545116800 00000100:00100000:0.0:1789135900.689577:0:14737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545116800 00000100:00100000:0.0:1789135900.689624:0:14737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789135900.689633:0:14737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3313:x1876044545116800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135900.689694:0:14737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6499b41b-f800-46b7-9637-f4c3e1cfbd8f+19:3313:x1876044545116800:12345-0@lo:400:kworker.0 Request processed in 63us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135900.689700:0:14737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789135900.689746:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545117312 00000100:00100000:0.0:1789135900.689750:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545117312 00000100:00100000:0.0:1789135900.689782:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545117184 00000100:00100000:0.0:1789135900.689785:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545117184 00000100:00100000:0.0:1789135900.689801:0:14744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044545117056 00000100:00100000:0.0:1789135900.689804:0:14744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044545117056 00000100:00100000:0.0:1789135900.689819:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135900.689827:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc3adb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545117312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135900.689865:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc3adb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876044545117312:12345-0@lo:400:kworker.0 Request processed in 39us (3616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135900.689872:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135900.689884:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135900.689903:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545117184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135900.689966:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876044545117184:12345-0@lo:400:kworker.0 Request processed in 63us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135900.689973:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789135900.689974:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135900.689981:0:14738:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135900.689991:0:14744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789135900.689998:0:14744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc41bf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545117056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135900.690031:0:14744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc41bf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876044545117056:12345-0@lo:400:kworker.0 Request processed in 33us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135900.690037:0:14744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135900.690096:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3adb03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876044545117056:0@lo:400:kworker.0 00000100:00100000:3.0:1789135900.690112:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3adb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876044545117184:0@lo:400:kworker.0 00000100:00100000:1.0:1789135900.690361:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3adb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6499b41b-f800-46b7-9637-f4c3e1cfbd8f:3313:1876044545116800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135900.690393:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8adc3adb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876044545117312:0@lo:400:kworker.0 00010000:00010000:2.0:1789135900.876141:0:14730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30609 lines, 30609 kept, 0 dropped, 0 bad.